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CHAPTER I 


INTRODUCTION: THE REPUTATION TEST 


"A. PREVIOUS. INVESTIGATIONS 

Г srvpviNG child personality, most in- 
vestigators utilizing rating procedures 
have depended upon the impressions of 
adults—parents, teachers, or psycholo- 
gists. However, the influence of other 
children constitutes a major component 
of the social milieu to which the child 
must adapt, and his behavior with them 
may differ in many ways [rom that which 
he exhibits in other groups. This im- 
Portant domain is peculiarly inaccessible 
to the adult observer, whose very pres- 
ence Alters the situation under study. In 
‚ Order to investigate those aspects of 
child personality which are revealed in 
the social relationships obtaining among 
children, a method is needed which per- 
mi?s the children themselves to express 
their attitudes toward one another in а 
Manner which is adapted to their ca- 
Pacities, which avoids disturbing them 
or provoking undesirable attitudes of 
“tattling” on their associates, and which 
meets the practical criteria of ease of 
administration, quantifiability, and reli- 

ability of measurement. І 
To meet this need, Hartshorne, May, 
and Maller in 1929 devised the “Guess 
Who" test in connection with their in- 
Véstigations of service and altruism 
among school children (3). This test 
consisted of a series of short word pic- 
tures presented with the instructions that 
the children "guess" which of their class- 
Mates were most nearly like the persons 
described. This procedure successfully 
circumvented the practical difficulties of 
Securing a measure of repujation, and 
Achieved a high degree of reliability in 
the final ratings by pooling*the extreme 
ludgments of a large number of judges. 


The method has subsequently been 
used by C. M. Tryon (9), by Н. E. Jones 
(4). by Symonds and Jackson (8), and by 
Elliot (2) to study children's social ad- 
justment; by Campbell (1) to study sex 
differences in judgment patterns of ado- 
lescents; and by Tryon (10) to study 
adolescent personality values. Moreno 
(7) has adapted a similar procedure to 
the study of spontaneous social group- 
ings. Results of these investigations have 
indicated that reputation testing offers 
a promising approach to a variety of 
problems in personality development, 
and further, that the method supplies a 
type of information which is not ob- 
tainable by means of the more common 
devices which secure ratings by adult 


observers. 
For these reasons, reputation testing 
was added to the program of data collec- 


tion of the University of California 
Gifidance Study, and was administered 
beginning at the first-grade level (5). 
Since the subjects of this study were con- 
siderably younger at the beginning of 
the program than any who had been 
modifications of item- 
nd mode of ad- 
ed. Macfarlane, 


tested previously, 
selection, terminology, а 
ministration were requin 
Honzik, and Davis (6) have published 
a preliminary report on the effectiveness 
of the method with these primary grade 
children. The present monceraph is 
based on the complete data of this testing 
program at grade levels I, IH, and V. 


B. PURPOSE or THE PRESENT 
INVESTIGATION 


The purpose of this study is to explore 
the possibilities of the Reputation Test 
as a device for studying social aspects of 
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personality development in children of 
elementary school age. 

Analysis of the mass of data obtained 
from more than 2,700 individual test 
administrations has suggested many more 
avenues of research than could be dealt 
with in one monograph. The present re- 
poris have been restricted to two inter- 
related problems. On the normative 
level, we have studied group differences 
in reputation as related to age and sex 
lor the light they throw on the general 
process of social development during this 
period of childhood. On the level of 
qualitative diagnosis, we have investi- 
gated the usefulness of the Reputation 
Test in locating the socially atypical, 
disliked, or withdrawn children who 
need special help, by means of a com- 
parison of “blind” interpretations of 
individual records with relevant data 
from other sources. 

In a domain in which speculations are 
more numerous than facts, the supplying 
of normative data and the refinement of 
method are necessary preliminaries to 
the moré crucial tests of theory. At the 
risk of violating a major criterion of 
scientific respectability, the present in- 
vestigation has been formulated not as a 
Statistical proof or disproof of any ex- 
Plicit hypothesis, but rather as an ex- 
ploration of methods for Studying this 


area of Personality and its developmental 
sequences, 


Persons fitting the description. 


ing the positive or desir^ble pole of behavior, ше 
other the undesirable pole along the same dimen 
sion. For example, items 13 and 14 read: (=) 
“Which children are poor sports? (are ees 
1оѕегѕ?)” and (+) "Which children. are enn 
sports? (good losers?) (play fairz)." Тһе iens 
were originally categorized as favorable or un 
favorable for adjustment on the basis of ami 
cians’ judgments. It was later discovered that un 
the "favorable" items were positively corrclate 
with the item hereafter referred to as Boum 
Throughout the discussion the individual Laid 
tions will be referred to interchangeably me 
"items" or "traits"; paired questions will be a 
ferred to interchangeably as — "item-pairs, 
"dimensions," and “variables.” n 
The test as used in the first, second. and n 
tain third grades consisted of ten pairs of an 
referring to either sex, a pair of items ан 
exclusively to boys and a pair to girls, hes 
unpaired item, “Who is your best friend?” 1 ae 
additional item-pairs were added in the iM 
ОЁ certain. third- and all fourth-grade Сла 
since the older children were able to haw а 
longer test without fatigue. Four more Pd 
were added when the test was given to fifth- ar 
sixth-grade classes, ne 
For children in the primary grades it was ae 
sidered essential that the wording of items be à 
brief and simple as possible, The expression, 
"Here is somcone who is—" used by Tryon, He 
abandoned in favor of a direct question, and p: 
vocabulary chosen from words actually used м 
the children in interviews. At grade levels V an 
VI, some items were lengthened where expel 
ence had shown that additional descriptions were 
advisable, and the vocabulary was adapted ш 
increased age of the subjects, but the о 
wording of the items was not materially alt ree 
in most instances, The items Takes CHANGES: 
REAL Boy, and Acts Like Lrrrtg Lapy and their 
antonyms were rephrased because experience sug- 
gested the possibility that the original formulas 
might no longer be conveying the intended 
meaning. The original and revised forms of the 
items are presented in Tables 1 and 2, respec- 
tively, together with the titles and symbols which 
Will be used for the sake of brevity in referring 
to them in subsequent pages. The titles appended 
in the course of data analysis arc not in all cases 
Synonymous with the actual items to which the 
children responded and upon which all findings 
are based. This fact should be kept in mind in 
interpreting the contents of following chapters- 


* Despite the ch 
showed the same 
the unmodifi 


anges in phrasing, these items 
regular trends with age as did 
-d items, See Chapter III. 


| 


IF FIE 


Nor 4 Suow-Orr, and LEADER— 


View to rr of the 20 third. 


ә 


Nor А LEADER, which we 
-grade classes and to fourth 
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d TABLE : 
THE ORIGINAL FORM or THE REPUTATION TEs? (INDIVIDUAL ADMINISTRATION) 
Item Title Symbol Item 
=f x. WicGLY Which children wiggle a lot and can't sit still? 
+\ 2 Quer Q Which children sit very still and quiet? 
E 3- POPULAR Р Who аге the ones everyone likes? 
—| 4. Nor Many FRIENDS Who are the ones nobody likes very much? 
+( s. FuLL or FUN ЕР Which children are always smiling and laughing? (аге 
full of fun?) 
— | 6. SERIOUS Which children don't smile very much and seem sort of 
sad? 
—( 7. QUARRELSOME What children quarrel a lot? (get into arguments?) 
+{ 8. Nor QuARRELSOME QI— What children hate to quarrel? (don’t quarrel much and 
keep out of arguments?) 
o. DoEsx'r TAKE CHANCES Which children get scared of everything? (are 'fraidy 
cats?) (are too scared to take chances?) P. 
+)10. TAKES CHANCES e Who are the bravest and almost never get scared? (take 
big chances and are not easily scared?) 
—[rr, Bossy What children are bossy? (try to run things?) 
112. Nor Bossy B- Which children let other children boss them? (usually 
give in?) х 
[тз.7 Poor Sport Which children are poor sports? (are poor losers?) 
\:4. Соор Sronr S Who are good sports? (good losers?) (play fair?) 
15. BASHFUL Which children are the most bashful? (hate reciting?) 
16. Nor BASHFUL Ba— Which children aren't the least bit bashful? (don't mind 
d reciting?) 
17. Соор AT GAMES G Which children are the best at outdoor games? 
18. Nor Соор at GAMES Which children aren’t very good at games? 
—[?o. Gers Map EASILY Which children get mad the easiest? ; 
+\20. Dorsn’r Ger Map M-— Which ones don’t get mad much? . 
=at Stssy What boys are the worst sissies? x 
+422, REAL Boy RB Who are the real boys—the regular fellows? (аге never 
sissies—they just act like boys?) 
—=f23. TOMBOY What girls fre tomboys? (act like boys and play boys’ 
ames? f 
+l24. Acrs Lixe LrrrtE Lavy LL What girls act like little ladies? 
+ 25. Best FRIEND BF Who’s your best friend? 
Note: itional item-pairs Goop-LookrNG—NOT Goop-Look1NG, SHow-Orr— 
ote: See Table 2 for the additional item-pairs re added to the test administered bv inter- 


-grade classes. 
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TABLE 2 | 


Tue REVISED FORM or THE REPUTATION Test (GROUP ADMINISTRATION) 


Item 


Item Title Symbol 
f т. WiGGLY 
2. QuIET Q 
3. PoPULAR P 
4. Nor Many FRIENDS 
5. FuLL or Fun FF 


6. SERIOUS 


—f{ 7. QUARRELSOME 

+; 8. Nor QUARRELSOME OI— 
"F(1o. TAKES CHANCES С 
—| о. Dozsw'r ТАКЕ CHANCES 

— [11. Bossy 

+112, Nor Bossy B- 
+/14. Соор Ѕрокт 5 
—\13. Poor Sporr 

— (15. BASHFUL 

+ |16. Nor BasnruL Ba— 
M. Соор at GAMES G 
—|18. Nor Соор at GAMES 


(з. Gers Map Easity 


20, Doesn't GET Map M- 
22. REAL Boy RB 
21. Sissy 


(23. Томвоү 


+ |24. Acts LIKE LITTLE Lapy LL 
A Goop-Looxtnc* GL 
— (27. Nor Goop-Looxtne 
— |28. SHow-Orr 
+\29. Nor a SHow-Orr Sh— 
+ (зо, LEADER L 
—]|31. Nor a LEADER 
+{32. Tipy** d 
—183. Ury 

n Етснтѕ 
+135. Doesn't FIGHT F— 
-F[36. FRIENDLY Fr 
—137. Nor FRIENDLY 
+(38. TAKES JOKE ox SELF 
—139. CAN'T TAKE A JORE 1 
+ 25. Brsr FRIEND BF 


Which children wiggle a lot and can't sit still, or get UP 
and walk around a lot? | cd 

Which children sit very still and quiet? 

Who are the ones everybody likes? T 

Who are the ones nobody seems to care much about? 

Which children are alway 
full of fun? 


" zo sad 
Which children don't smile much and seem sort of 
or serious? 


ili ing à are 
smiling and laughing and a 


Which children quarrel and argue a lot? z üt 
Which children don't quarrel much and usually keep о 

of arguments? ihey 
Who are the ones that like to take big chances when they 

are playing games? ike to 
Which ones hardly ever take chances and don't like 

do it? 

ER H ә, T 
Which children are bossy and try to run things? those? 
Which children give in to others and hardly ever ^ i 
Who are the good sports, the ones that always play e n 
Which ones aren't very good sports, the poor losers? - 
Which children are the most bashful and don't like to 

cite in class before visitors? 1 don't 
Which children aren't the least bit bashful anc 

mind reciting in class before visitors? 5 
Which children are good at games and play them well? 
Which children aren't very good at games? 
Which children get mad thee 
Which children hardly eve 
Who are the r 
роу do? 


е " ; 5 
hat boys don't enjoy doing all the things regular boy 
o 


asiest, lose their temper? E 
r get mad or lose their tempe! = 
cal boys that enjoy doing all’ the things 


What girls like to play boys’ games and do the things 
boys do? | һе 

What girls don't like boys’ games at all and just do t 
things girls do? 


a are the ones everybody thinks are good looking? 
WI 


oare the ones very few people think are good looking? 
Which ones show off a lot and act silly? A 
Which ones hardly ever show off or act silly? 


Which children are good at starting games and getting 


things going—the ones that suggest things to do? t 
Who are the ones that just sit around and never star 
anything? 
Which children look most neat and tidy? 
Which children don't look very neat and tidy? 
Which children get into lots of fightsand like to fight? 


Which children never get into fights and hate to fight? 
Which children are very friendly and nice to everybody? j 
Which children don’t care much about making friends О 
being friendly? 


Which children can laugh at a joke on themselves? 


Which children can never laugh at a joke on themselves 
they just get mad,or cry about it? 
Who is your best friend? 


К Items 26-31 were added fo; 


tems 32-39 were added ee ш е third-grade classrooms and for the fourth gr. 


ade. 
xth-grade classrooms, 


CHAPTER II 


POPULATION AND METHODS OF ADMINISTRATION 


^ A. POPULATION STUDIED 

HE PRESENT investigation is based 
je Reputation Test data collected 
as a part of the University of California 
Guidance Study, a longitudinal investi- 
gation of the physical, psychological, and 
social development from birth to ma- 
turity of 250 Berkeley children. The 
method of selection and demographic 
characteristics of the Guidance Study 
sample have been described in detail by 
Macfarlane (5). Suffice it to note here 
that they constitute a subsample from a 
group consisting of every third child 
born in Berkeley, California, between 


` January 1928, and July 1929, and that 


their families resembled the general 
urban population of the United States 
(1930 census), though differing in some 
respects. Since the Guidance Study files 
afford rich and varied psychological ma- 
terial on the subjects from sources other 
than the Reputation Test, all individual 
cases used to illustrate the diagnostic 
value of the Reputation Test were 
drawn from the Guidance Study sample. 
(Sce "Studies in Reputation. II. The Di- 
agnosis of Social Adjustment.") | 
The normative studies of reputation 
reported in subsequent chapters were 
based on a much larger group than that 
described above. The Reputation Test 
can be given only to a whole classroom. 
The need to secure data periodically on 
as many Guidance Study cases as possible 
Within existing time limitations deter- 
mined the choice of schoolrooms to be 
tested. However, the classmates of Guid- 
ance Study subjects constituted a very 
much larger proportion of tke final pop- 
ulation than did.the Study ‘cases them- 
selves. The Guidance Study children 


were by age six scattered widely through- 
out all the school districts of Berkeley, 
and owing to special promotions and 
failures, soon came to represent a grade 
range of three or more years. Since only 
a few of the classrooms in which Guid- 
ance Study cases were located could be 
tested in any one year, the program of 
data collection was of necessity irregular. 
However, the sampling of the Berkeley 
school population was a broad one, and 
all elementary schools in Berkeley were 
represented at least once during the 
years the data collection was in progress. 

The Reputation Test was adminis- 
tered in 85 classrooms including all six 
grade levels of the elementary school 
system. In order to simplify statistical 
treatment, results from classrooms of the 
same grade level were pooled and data 
analyzed only for the alternate grade 
levels I, III, and V, a procedure which 
was adequate to reveal the trends with 
age which constituted on focus of our 
interest. Shifts in reputation within the 
same classroom over a long temporal 
interval were not studied because retest- 
ing had not been sufficiently extensive 
or regular. Socioeconomic differences 
among classrooms pooled were disre- 
garded, but the size of the total sample 
and the nonsystematic selection of class- 
rooms for inclusion at any level served 
to reduce sampling errors arising from 
this treatment. Future research iigh: 
profitably be directed to these problems 
of temporal change in individual repu- 
tation and of differences in judgment 
patterns at various socioeconomic levels. 

The number of children on whom 
the present report is based is given in 
Table 3. It should be understood that 


6 READ D. TUDDENHAM 


TABLE 3 ' 
JERE ANALYZED 
NUMBER оғ CHILDREN ғов WHOM REPUTATION Test DATA WERE ANALYZ 


Number in Class Number Present 
oed - Я 3ovs Total 
Grade Classes Girls Boys Total Girls Joys 
irst Grade T i66 
аа І to 25 4 49 70 119 41 » 5 
Third Grade А Е" бах 
fens I to 25 20 340 352 692 318 x p 
Items 26 to 31 Ir 178 194 372 169 
i 312 608 
eet 39 18 306 322 628 i 296 312 


all analyses referring to reputation scores 
are based on the “number in class” (in- 
cluding absentees), while all analyses re- 
ferring to votes given or to self-mentions 
are based on the “number present.” 


B. ADMINISTRATION 


In Grades I, II, III, and IV, the test 


was administered to each child in an in- 


dividual interview. After the purposes 


of the test had been explained to the 
teacher and the principal, the teacher 
was asked to send to the interview room 
one child at a time, Starting with the he 
or two socially most secure and popular, 
then the others in any order. 


'To the child, instructions were as fol- 
lows: 


good you are at guessin: 


n in your room. I'll tell you 
Just what these children do, and you tell me who 


t may be one person or two 
it might even be you." 


The questions were then asked of the 


child one by one. Whenever a child gave 


evidence of failing to understand the 
original 


phrasing of a question, the in- 
dicated alternate formulas were substi- 
tuted. The interviewer recorded each 
child’s Nominations on а sheet prepared 
for each item-pair with the pupils’ names 
listed dowi. one side and repeated across 
the top. Individual mentions on. the 


favorable or unfavorable item of a di- 
mension were indicated respectively A 
a plus or minus sign placed in the s 
umn of the child mentioning, and d 
row of the child mentioned, a methot 
Which facilitated analysis both of ben 
received and of votes given. The ag 
also, was asked to supply information ш 
the same form about the children in a 
class. By this procedure, data of fou 
sorts—mentions of others, selimenton 
mentions by classmates, and mention” 
by the teacher—were obtained concu! 
rently for each child. ә 
The test took as а rule about eight 0! 
ten minutes for each child, the increas 
ing length of the test from grade to grade 
being compensated for by the children $ 
greater maturity and verbal facility. 
For Grades V and VI, the extremely 
time-consuming method of individual 
administration was abandoned in favor 
of group administration to each class, 
after the feasibility of the change had 
been established by a comparison of in- 


dividual vs. group test results from à 
sample room.: 


*In one fifth-grade classroom, individual inter- 
viewing was followed after a two-month interval, 
by a written group testing, Although СВ) 
ancies might Гауе arisen from changes in actua 
reputation ba&ween testings as well as from the 
effects of the change in administrative procedure, 
the two sets of data were in close agreement, а 
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А 

The verbal insttuctions which pre- 
ceded distribution of the test booklets 
were: 

“Here are some questions about things chil- 

dren do or the way they feel. Write after cach 
question the names of any boys or girls in your 
class who may fit it. You may name yourself. lf 
the question does not fit anybody in the class, 
skip it. Before you begin, be sure to put your 
name on the front cover of the booklet.” 
In the case of nonreaders, the examin- 
ers made a routine practice of reading 
the items to the children and recording 
their nominations. 

Group testing reduced the time re- 
quired per class of go from between four 
and five hours to approximately 40 min- 


‘utes, and clearly justified itself by in- 


creasing correspondingly the number of 
classrooms which could be covered and 
by making possible the inclusion of ad- 
ditional items in the test. However, the 
change from individual to group admin- 
istration rendered the results for upper 
grades not strictly comparable to those 
for lower grades. A more serious disad- 
vantage was the loss of the spontaneous 
comments by the children, which had 
supplied a constant check on how the 
items were being interpreted. Among 
tho many such remarks collected, the 
following illustrate this point: 


fact which suggested that reputational status has 
considerable constancy over this interval. The 
mean correlation between individual and group 
test scores on a single item was .77- The range 
was from .48 to .95, but the lower correlations 
tended to be more the consequence of few men- 
tions and small SD's than of actual disagree- 
ment, On only one item was there a significant 
difference between mean scores obtained by the 
two testings. One trend did appear, however. In- 
cluding nonsignificant differences, 17 of the 19 
favorable items yielded more mentions in the 
individual interview, while 13 of the 18 un- 
favorable items yielded more megtions on the 
group test—an amusing reversal of the pattern 
of adults who are usually more willing to express 
critical judgments in speech than in writing. 


^ 


n 


Acts Like итге Lapy (from a girl): “Lucy 
acts like a little lady. She always carries a hand- 
kerchief and wears a coat.” T 

PoruLar (from a boy): "Oh, everybody likes 
Louise because she's so nice and rough. She's 
manager of our gang and I'm vice-manager." 

Poor Sronr (from a girl): "I heard Bobby say, 
‘Oh, damn those old girls!’ So he's a poor sport." 


C. ATTITUDES TOWARD THE 
REPUTATION TEST 


Children in the primary grades usually 
made a favorable response to the test as 
a whole. "I wish I could have two turns." 
"Your game was an awful lot of fun. 
Thanks a lot." "Is there a prize for the 
one that guesses the most right?” Oc- 
casionally in the fourth grade, and more 
frequently in the fifth and sixth grades 
of schools drawing from the middle and 
upper social strata, a child would reject 
an item, as for example: “I don’t like to 
recommend anybody as a poor sport.” 
Rejection, sometimes extending to the 
whole test, seems to be less infrequent at 
the junior high-school level where social 
acceptance becomes a matter of uneasy 
co'icern for many adolescents. It was not, 
in our experience, an obstacle in the 
elementary school. 

A more serious problem was the atti- 
tude of some school administrators that 
the Reputation Test might make the 
children critical of each other, and undo 
school attempts to provide an acceptant 
and tolerant social atmosphere. At the 
beginning of the program of data collec- 
tion, the Guidance Study staff shared 
this concern. Interviewers were told to 
watch for signs of possible discomfort- 
their informants, and to discontinue if 
they occurred. However, the alacrity and 
matter-offactness with which nomina- 
tions were volunteered soon made it 
clear that the Reputation Test was 
merely tapping attitudes already well 
crystallized in each classroom group. In 
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requesting cooperation from school prin- 
cipals, we therefore attempted to antici- 
pate and answer this objection, and to 
emphasize the very real value of the test 
to the school, in locating the children 
most in need of social support. The 
formulation used is quoted in full in 
Macfarlane’s monograph (5, p. 53). 
Parents were naturally interested in 
the testing program, but only a handful 


made complaints to the schools. Usually 
they were parents of insecure or unpopu- 
lar children, and in nearly all instances 
were reassured when they learned of the 
schools’ efforts to utilize the test results 
constructively to improve the social ad- 
justument of unaccepted children.* 

?See Elliott (2) and Tuddenham (11) for cx- 


amples of practical applications of the results in 
this way. 


CHAPTER ПІ 


PATTERNS IN REPUTATION 


K ie capacity of the Reputation Test 
to reveal the opinions which a class- 
room group has formed concerning à 
given class member is one of its princi- 
pal values in individual diagnosis, but 
the significance of a child's reputation 
‘can be assessed only in relation to ap- 
propriate norms. In the present chapter 
such norms are presented by sex and 
grade level [or the Berkeley population 
tested. The results are of considerable 
intrinsic interest for the light they throw 
upon grade-school children's conceptions 
of masculine and feminine personality 
attributes, and upon changes in these 
conceptions with advancing grade level. 
The correspondence between the chil- 
dren's attitudes and the stereotypes of 
adults in American society at large sug 
gests that the trends evidenced in the 
data may apply much more widely than 
just to the California group investigated. 


A. STATISTICAL TREATMENT 


In dealing with children's reputations 
"with classmates, each pair of items was 
treated as a single dimension, a linear 
Continuum whose extremes were defined 
by the opposed items of the pair con- 
cerned. On each such dimension, the 
number of mentions received by a given 
child on the favorable and unfavorable 
items of the pair were summed algebrai- 
cally to yield a measure of his reputation 
on the dimension as a whole. Since it 
Was desired to pool data from all the 
classrooms of the same grade, it was 
further necessary to correct the algebraic 
sums of votes received for variations in 
the size of the different classes. The cor- 
rected score for each child 9. each item- 
Pair dimension was obtained by dividing 
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the algebraic sum of plus and minus 
votes received by the number of children 
present in class for the test, exclusive of 
the child himself, and multiplying by 
100. (Sell:mentions were treated sepa- 
rately.) This percentage is referred to 
hereafter as the item-pair score or di- 
mension score. A child mentioned by 
everyone else in his class as possessing the 
favorable attribute had a score of 4-100, 
while one mentioned by all as possessing 
the undesirable quality had a score of 
— 100. The neutral point of nonmention 
(or of an equal number of plus and 
minus mentions) was zero, a score which 
proved to be modal on all dimensions, 
regardless of sex or grade level. This last 
finding is a consequence not only of the 
cancellation procedure used in scoring, 
but also of the nature of the test itself, 
which unlike most rating devices secures 
mentions only of children who are clearly 
eXtrenie in the judgment of the rater. 
Anticipating the findings of Chapter V, 
y 20 per cent of the children in 
these age ranges received a zero score on 
the. average item, and of these about 
half received a zero score in consequence 
of being named equally often for op- 
e traits. In most cases children in 
group were mentioned not 
he opposite poles 


roughl 


posit 
the latter 
more than twice on t 
of the dimension concerned. Thus, even 
though an algebraic summation proce- 
dure which tended to inflate the 1...7 
ber of zero scores was used, the "indif- 
ference band" was quite narrow, and 
four out of five children received a defi- 
nite characterization on the average 
item-pair. 

A disadvantage of basing analysis upon item- 
pairs rather than items was the possibility that 
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the items of a given pair might not be strict 
antonyms, and that cancellation of positive and 
negative votes on a given dimension might hence 
be inappropriate. While the items of a pair were 
phrased to be as "opposite" as the semantic acu- 
men of the staff could make them, a further 
justification for this mode of treatment was the 
fact that in no instance did a child mention a 
given classmate on both items of a pair. A sec- 
ond possible disadvantage was the tendency of 
such algebraic summation to obscure small devia- 
tions from the indifference point. However, these 
small deviations are undoubtedly much less reli- 
able than extreme scorcs and may not merit con- 
servation. The statistical advantages of more 
nearly symmetrical score distributions and in- 
creascd score variability were further reasons for 
treating the reputation data in terms of item- 
pairs rather than items. 


В. Sex DIFFERENCES IN SCORES 


Means and standard deviations on the 
various dimensions of the Reputation 
Test are presented separately for boys 
and girls in Table 4. However, the es- 
sential findings are most easily grasped 
by inspection of Figure 1, which is drawn 
from the means presented in the table. 

Perhaps the most striking fact to be 
noted is the marked difference in the 
reputation of the average girl and boy. 
Apparently, even first-grade children 
make rather clear-cut distinctions in the 
qualities they attribute to boys and to 
girls, associating quiet docility and 
friendliness with femininity—aggressive- 
ness, boldness, and activity with mascu- 
linity. 

OF equal importance is the fact that 
girls on the average enjoy more favor- 
able status than boys on a majority of the 
item-pairs. In many instances this dif- 
ference is highly significant (see "Table 
5). On certain item-pairs, the reput 
of boys are not only less favorable than 
those of girls, but are indeed on the 
negative side of the indifference point, 
7the average boy being characterized as 
QuaRRELsome, Bossy, Gers Map Easirv, 
Nor Goó»-Lookixc, WiGcry, Untiwy, 


ations 
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and Ficus. Eviderce that the children 
themselves and not merely the test con- 
structors regarded these items as unfavor- 
able is supplied by their negative corre- 
lations with the dimension PoPULAR-NOT 
Many FRIENDS in all sex-grade groups. 
Few writers concerned with the sexual 
differentiation of adult personalities have 
emphasized the point, yet it seems clear 
that the marked difference in the climate 
of opinion faced by the average boy as 
compared with the average girl in rela- 
tionships with other children could 
scarcely fail to produce a residual dif- 
ference between men and women in s0- 
cial attitudes. We suspect that the 


atmosphere of disapproval surrounding 


the average small boy as contrastec with 
the small girl may well be a factor 11 
the nonconformity and resistance to au- 
thority which are often attributed tO 
male adolescents and adults in our 80° 
ciety. 


C. GRADE LEVEL DIFFERENCES IN 
Sconrs 


The sex differences reported above 
suggest that stereotype thinking about 
"girl traits" and "boy traits" seriously 
influenced the judgments of our inform 
ants, even though these judgments 
were secured in the form of identifica- 
tions of actual classmates on the various 
dimensions rather than descriptions of 
the "average" boy or girl. If, however, 
our findings reflect largely sex stereotypes 
of judges, we might expect these stereo- 
types to grow more differentiated with 
advancing grade level. In fact, exactly 
the converse was found, the mean тери" 
tation scores of the boys and of the girls 
tending to move closer together in suc 
cessive grades. This trend seems to be 
primarily the consequence of a shift 1n 
the favorable direction for most of the 
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MEAN SCORES OF BOYS AND OF GIRLS 
ON REPUTATION TEST IN GRADES 1,11 AND V 
Gils ШШШ Boys ( —3 


SCORE {ш Judges (lows Nj 


È 


олњ отъ о 


й3 


barknon ta & 


FULL OF FUN 


Grode ! "n ү 
NOT QUARRELSÓME 


SERIOUS 


GOOD SPORT 


óo^womvmh^oó 


POOR SPORT 
REAL BOY 


ЕЗ 


QUARRELSOME 


NOT BAZHFUL 


т 
Фол моњ ha 6 


BASHFUL. 
" ACTS LIKE LITTLE LADY 


óo^wvowvw^o 


bunonsad 


1 


m v 
кт QUET = POPULAR 
6 6 
4 4 
2 2 
о о 
г 2 
4 4 
6 6 
-8 -8 
WIGGLY NOT MANY FRIENDS 
fe TAKES CHANCES +ё NOT BOSSY 
6 6 
4 4 
2 2 
о о 
г 2 
4 4 
6 6 
-8 -8 
DOESN'T TAKE CHANCES Bossy 
GOOD AT GAMES dn DOESNT GET MAD EASILY 
6 
4 
2 
o 
2 
4 
6 ә 
-8 
МОТ GOOD AT GAMES GETS MAD EASILY 
BEST FRIEND +8 GOOD LOOKING 
6 
4 
2 
o 
2 
4 
"уам eu Ө 
В NOT GOOD LOOKING 
TIDY 48 DOESNT FIGHT 
6 
4 
e 
о 
2 
4 
6 
-8 
UNTIDY FIGHTS 


oo 


" 
óo^wvowv^o 


SISSY 


NOT A SHOW OFF 


TOMBOY 


LEADER 


Hn 
omanoma oad 


SHOW OFF 
FRIENDLY 


LI 
óo^womw^o 


NOT FRIENDLY 


NOT ALEADER 
TAKES А JOKE ON SELF 


CAN'T TAKE A JOKE 
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2 TABLE 5 
SIGNIFICANCE OF DIFFERENCES IN MEAN SCORES or GIRLS vs. Boys 

| Grade I Grade III Grade V 

ltem-Pai Critical Pai Critical Р ЕИ 
т-Раіг Рано Item-Pair Ratio Item-Pair Саа 
А. Item-Pairs On Which Girls Have More Favorable Reputation 
Nor Duaanstsous 5.8 Nor QUARRELSOME 9.0 QUIET 8.3 
pee 4.6 QUIET 8.1 Tipy 7.9 
eke 3.2 Dorsw'r GET MAD 5.5 Nor A Snow-Orr 5.7 
дот Bossy 2.8 POPULAR 4.9 Dozsx'r FIGHT 4.7 
F OESN’t GET MAD 2.4 Nor Bossy 4.4 NOT QUARRELSOME 4.1 
FULL OF Fun 2.3 Goop-LookING 3-8 FRIENDLY 4.0 
Goop at GAMES 1.8 Nor A SHow-OFF 3:2 Goop-LookING 2.6 
Соор SronT FA Соор SPORT 2.4 Doesn’t GET Map 2.0 
Best FRIEND =a FuLL or FUN I.4 Nor Bossy т.б 
Best FRIEND .6 POPULAR т.2 
Соор SPORT .8 
Best FRIEND .6 
B. Item-Pairs On Which Boys Have More Favorable Reputation 

Nor BASHFUL 1.3 TAKES CHANCES 6.0 TAKES CHANCES 5.6 
Takes CHANCES ‚8 Соор AT GAMES 2.2 Соор AT GAMES 3.3 
Nor BASHFUL 1.2 Nor BASHFUL 2.7 
5 LEADER xm Can TAKE JOKE 1.4 
LEADER 28 
FuLL or FUN E 
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Secondarily, there is а 
hift in 
st on 


boys’ means. 
tendency for the girls’ means to $ 
the unfavorable direction, at lea 
certain traits. Dimensions which show 
most clearly the upward trend with grade 
level in boys’ mean scores and the re- 
verse in girls’ are POPULAR; FuLL or FUN, 
Nor QuannELsoME, NOT Bossy, Соор AT 
Gamers, and, most conspicuously, REAL 
Boy and Acts Like LITTLE LADY. Other 
item-pairs of the complete test might 
also have exhibited this phenomenon, 
but since they were added late in the 
comparative data for 
re not available. 

d above is strik- 
item-pairs men- 
evel differences 
he sex differ- 
ignifi- 


testing program, 
various grade levels a 
. The age trend note 
ingly consistent for the 
tioned, but the grade 
are usually smaller than t 
ences and are rarely statistically 5 
cant. Indeed, in the case of girls’ means, 
No dimensions show a significant increase 


in score with advancing grade level, but 
some of those which show a marked drop 
from Grade I to Grade III show minor 
gains from Grade II to Grade V. 


D. SUMMARY OF SEX AND GRADE DIFFER- 
ENCES IN MEAN SCORE BY ITEM-PAIR 


1. Dimensions Included at Grade 
Levels І, III, and V 

1-2 WiccLy-Quier. The average girl 
is rated quiet by approximately six per 
cent of her classmates, at all grade levels, 
while the average boy is considered rest- 
less by about four per cent. Differences 
in mean score between grade levels are 
not significant for either sex, but the 
critical ratios of the difference between 

irls and boys range from 4.0 to 8.0. 

4-3 Nor Many Frienps—Porurar. The 
average girl is “liked by everyone” at all 
levels, but decreasingly so, while the score 
of the average boy, which is slightly be- 
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low the zero point in the first and third 
grades, rises in the fifth grade to a point 
which is positive although lower than 
that for girls. Sex differences in favor of 
girls are significant at Grades I and III 
but not at Grade V. Grade differences 
are not significant for girls, but for boys 
the improvement from third to fifth 
grades reaches significance (C.R. — 3.0). 

6-5 SrmroUs-FULL or Fun. The aver- 
age girl is judged to be Еши. or Fux, 
though her score is smaller than on 
Popurar and Опет. This item is one of 
the few on which boys enjoy favorable 
Status at all grade levels, but though 
their mean score increases with age, it 
does not overtake a diminishing score 
for girls until the fifth grade. Sex differ- 
ences are not significant, nor are age 
differences, although. the drop in the 
girls’ mean from Grade I to Grade III 
and the gain in the boys mean from 
Grade III to Grade V approach the con- 
ventional level (C.R.'s— 2.1 and 2.4, 
respectively). 

7-8 QuannELsoME-NOT QUARRELsOME. 
At all levels girls are rated Nor Quar- 
RELSOME and boys at the opposite side of 
the scale. This difference is Statistically 
significant at all grade levels but becomes 
less marked with age, and at the filth- 
grade level the average boy is regarded 
аз QUARRELSOME by only one per cent 
of the dass. Grade differences are not 
statistically significant save for the boys' 
gain in score from Grade III to Grade 
V (CR. = 3.1), 

9-10 Dorsw'r TAKE CHANCES-TAKEs 
Cuxnces. This is a unique item-pair, in 
that it is the only one on which boys 
enjoy more favorable sta 
at all levels, and the 
the aver 


tus than girls 
only one on which 
age girl received a negative score 
(Grades III and v only. Moreover, it 
shares with Соор AT Games, Nor А 


Suow-Orr, and Nor Basurvr. ihe dis- 
tinction of reversing the usual tendency 
for boys' and girls' scores to approxi- 
mate each other more closely with in- 
creasing age. The sex difference is sig- 
nificant in Grades III and V. Age differ- 
ences are negligible for boys, but the 
drop in the average girls’ score between 
Grades III and V approaches the level 
of significance. ‘Thus the trend seems to 
be more dependent upon the girls grow- 
ing timid than upon the boys growing 
bolder. Apparently the older girls — 
to conform to the feminine, pattern © 
our society and suppress their first-grade 
venturesomeness. 

11-12 Bossy-Nor Bossy. Nor Bossy 
is applied to the girls at all levels, 18 
converse applied to the boys. The al- 
leged bossiness of boys declines with age 
and the fifth-grade mean scores for boih 
sexes come to lie very near the zero point 
However, girls are rated significantly 1655 
bossy than boys in Grades I and II 
(C.R.’s = 2.8 and 4.4, respectively). Age 
differences are not significant on this 
dimension. . 

13-14 Poor Ѕровт-Соор Sport. This 
item-pair conforms to the pattern of 
other results, if not to the preconcep- 
tions of the writer, in that girls are con- 
sistently rated better sports than boys 
However, both groups are scored on the 
positive side, and the trend leads us to 
make the extrapolation that by the 
seventh grade, perhaps, boys would be 
considered at least as good sports as the 
girls. Sex and age differences are not 
statistically significant on this dimension: 

15-16 Basurut-Nor Basurur. МОТ 
BasurUL shows по consistent grade 
trends either for girls or for boys. Both 
Sexes are at all levels rated on the posi- 
tive side with boys receiving a large" 
mean score than girls. The boys’ mean 
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score ificreases. between the third and 
fifth grades to a degree which approaches 
significance (C.R. = 2.0) and is probably 
significantly higher in Grade V than the 
girls’ (С.К. = 2.7). 

18-17 Nor Соор AT GAMEs-GOOD АТ 
Games. This item-pair resembles the 
Takes CuaNcrs dimension, in that boys’ 
scores grow more favorable with age 
while girls’ scores decline. However, both 
the average boy and the average girl re- 
ceive a favorable score at all grade levels. 
Age differences for both sexes are some- 
what below the conventional significance 
point. (C.R.'s fluctuate around 1.0 for 
boys and 2.0 for girls) However, sex 
differences are by the fifth grade defi- 
nitely.,reliable (С.К. = 3.3). The judges 
seem to regard this dimension as more 
or less the exclusive province of boys, and 
mentions of girls at either pole become 
relatively infrequent among older chil- 
dren. 

19-20 Gers Map EasiLy-Dorsv'r GET 
Map Елѕпу. Scores on this dimension 
are not extreme, the girls remaining on 
the positive side, the boys on the nega- 
tive at all levels. Age differences are not 
e considered more 


significant, but boys ar 
at the third- 


prone to get mad, especially 
grade level (C.R. = 5-5)- 
21-22 Sissy-R AL Boy; 23-24 Tomboy 
-Acrs Like LITTLE LADY. These item- 
boys and for girls 


Pairs correspond for 
considered 


and may conveniently be 
together. Here again the usual trend for 
boys' scores to increase an 
decrease is extremely marked and very 
consistent, although the mean for both 
sexes is toward the positive pole at all 
levels. The critical ratio of the difference 
in mean score at adjacent age levels is 
around 2.0 for boys and 1.0 for girls. jt 
Will be recalled that the wording both of 


the favorable iteras and tbeir opposites 


d for girls’ to 


was changed for fifth-grade classes, since 
it was felt that the item Sissy, as origi- 
nally phrased, was too emotion-loaded, 
while the comments of children led us to 
believe that the Lrrrte Lapv item-pair 
was tapping attitudes about neatness and 
fussiness rather than about femininity.’ 
However, the trend of the curves is per- 
fectly regular and apparently unaffected 
by the revisions, the boys becoming more 
boyish and the girls less “ladylike” with 
increasing age. 

95 BesT Frienp. This item, which has 
no antonym, shows slightly increasing 
scores with age, reflecting heavier voting 
on the question. Sex differences are neg- 
ligible, although girls have slightly higher 
scores at all three age levels. The aver- 
age child is mentioned by from 5 per 
cent to 6 per cent of his classmates as 
a Brsr FRIEND, the equivalent, in an 
average class of 30, of slightly more than 
114 votes received per child. 

о. Dimensions Included. Only at 
Grade Levels III and V 


27-26 Nor Goop-Lookixc-Goop-Look- 
ING. As might be expected, the girls re- 
able scores on Goop LOOKING, 
are rated slightly below 
t. Age differences on 


ceive favor 
while the boys 


the indifference poin 
this item are negligible, but the sex dif- 


ference is marked at both grade levels for 
which the item was included (C.R.'s = 
3.8 and 2.6 for Grades Ш and М, re- 
spectively). 

28-29 Suow-Orr-NoT А Suow-Orr. 
This is the only item-pair on which boys' 
scores grow less favorable with age. 57у 
are rated definite show-offs in the third 
grow more extreme in the 
On the other hand, the girls 
ble status at both levels 
ith age. Sex differences 


grade and 
fifth grade. 
enjoy а favora 
which increases W 


1See Chapter II, Table 2. 
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are significant at both the third- and 
fifth-grade levels (C.R.'s = 3.2 and 5-7, 
respectively). The difference іп mean 
score between adjacent grade levels is 
only about 1.5 times its standard error 
for both boys and girls. 

31-30 Nor A LrApDER-LEADER. LEADER 
is an attribute on which both the average 
boy and average girl receive favorable 
though small scores. The mean for boys 
slightly exceeds that for girls. For some 
undetermined reason, the scores for both 
sexes decrease in magnitude with age, 
though not to a significant degree. 


3. Dimensions Included Only at 
Grade Level V 


33-32 Untwy-Tipy. Tiv, an item for 
which we possess only fifth-grade data, 
seems to be an exclusive attribute of 
girls. The average girl is so regarded by 
eight per cent of her class, the average 
boy being named as untidy by one per 
cent. The critical ratio of this difference 
(С.К. = 7.9) is larger than that on any 
other dimension at this grade level save 
Wiccry-Quixr. ы 

34-35 Ficuts—Dorsn’t FIGHT. This is 
a dimension on which girls receive a 
favorable, boys an unfavorable score. 
The sex difference in means is four tim 
its standard error. 

37-36 Nor FRIENDLY-FRIENDLY. Both 
boys and girls are considered friendly, 
the girls to a significantly greater degree 
than the boys (C.R. = 4.0). 

39-38 Caw'r ТАКЕ А Jokr-Takrs А 
JOKE ow SELF. Both Sexes are rated as 
wwie to take jokes on themselves, but 


here boys lead the girls by an insignifi- 
cant margin. 


es 


E. VARIABILITY IN SCORES 


Standard deviatio 


) ns of score distribu- 
tions for se 


x-grade groups haye been pre- 


sented in Table 4, Sex and grade com- 
parisons tend to parallel those for the 
means cited above. As may be seen by 
inspection of the table, there is greater 
variability in boys’ than in girls’ scores 
at all three grade levels, probably because 
judges of both sexes are more given to 
naming boys than girls for undesirable 
qualities. On the other hand, score vari- 
ability shows little consistent relation 10 
grade level, the average standard devia- 
tion dropping very slightly from Grade 
I to Grade III and increasing ашу 
markedly from Grade III to Grade V. 
The decline in variability from Grade I 
to Grade III is possibly the effect of 
sampling error in the first-grade results. 
since the total population was small. To 
account for the increase from Grade Ш 
to Grade V, two other factors may ne 
suggested. First, the tendency of older 
judges to name more people per item 
results in the identification of a larger 
proportion of the class. Second, the m- 
creased agreement found among older 
judges operates to reduce the number of 
zero scores produced by cancellation, and 
thus increases the standard deviations. 
When individual dimensions are con- 
sidered, it is obvious that several dif 
ferent factors contribute to differences 
in score variability. The inclusion of 
Wiccrv-Quigr and Nor Many FRIENDS 
-PoPuLAR among those having large 
sigmas may result in part from the fact 
that they occur at the beginning of the 
test where voting is heaviest. The low 
variability of CAN'r TAKE Jokr-TAKES 
JOKE ом SELF is to be anticipated from 
its position at the end of the test, where 
mentions are few. On the other hand 
Stssy-Reat Boy and Tompoy—Acts Lik? 
LirrLE Lavy, which occur well along ng 
the test, have very large standard devr 
ations. Itens having large variabilitic* 
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for one sex only, such as Goop-Looxk- 
ING for girls and LEADER and Соор AT 
Games for boys, seem to have a special 
relevance for children of the one sex 
that they do not possess for the opposite. 
In general it seems safe to say that the 
item-pairs yielding large variabilities in 
Scores do so not only because they are 
More easily rated, but also because they 
refer to qualities of personality which 
seem important to the children them- 
selves. 


F. THE PROPORTIONATE DETERMINATION 
OF SCORES BY JUDGES OF THE SAME 
AND OF THE OPPOSITE SEX 


In considering the tendency for girls 
to enjoy on the average more favorable 
reputations than boys, one may raise the 
question as to the degree to which the 
reputations of boys and girls are deter- 
mined by members of the same and of 
the opposite sex. Figure 2 presents 
our findings on this point. As may be 
gathered: by inspection, on most items 
somewhat more than half of the votes 
received are cast by judges of the same 
sex. This tendency toward determina- 
tion of scores by judges of the same sex 
seems to increase slightly with grade 
level on most items. 

Scores on a few item-pairs, however, 
are determined for both sexes by about 
€qual numbers of votes from boys and 
Írom girls at all grade levels studied. 
Dimensions of this sort include Sissy- 
Rear Boy, Towsov-Acrs LIKE LITTLE 
Lany, Nor Goop-Looxinc-Goop-Look- 
ING, and Wiccerv-QuiET. Since judges 
Were urged to vote on as many items as 
Possible and since the REAL Boy and 
Lurie Lapy dimensions refer to persons 


9f one sex only, it is to be expected that 
iables are determined 


Scor 
Cores on these var ч Бе 
ftion to their 


by boys and girls in propo 
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frequency in the total population of 
judges. In the case of at least the WiccLy 
—QuiET pair, data on judgments to be 
presented in Chapter IV show that the 
equal contribution of boy and girl judges 
in determining scores was produced by 
a tendency of girls to mention boys as 
wiggly and of boys to mention girls as 
quiet. 

On every dimension included in the 
first-grade test, girls’ scores were deter- 
mined to a greater degree by votes from 
boys than were boys’ scores determined 
by votes from girls. In the fifth grade, 
on every dimension save Best FRIEND, 
the opposite situation obtained—boys 
being mentioned by girls relatively more 
frequently than girls were mentioned by 
boys. Results for the third grade fluctuate 
from item to item between these opposite 
tendencies. All these differences in rela- 
tive determination of scores by judges 
of the same and opposite sex are, how- 
ever, quite small and derive their sig- 
nificance from the consistency of the 
trend on all dimensions, rather than 
from the numerical values of the per- 
centages. ; 

In the first grade the finding is in 
part an artifact, since boys constituted 
59 per cent of the total group of judges 
and should be expected on a chance basis 
to determine by an equivalent percent- 
age the scores received by girls. How- 
ever, in the fifth grade the situation had 
reversed itself, though the boys were 
still slightly more numerous than girls 
in the population studied. 

Our data are only suggestive, but the 
findings cited are at least congruent with 
the hypothesis that age for age, girls are 
more mature than boys socially as well 
as physiologically, the girls taking the 
lead both in sex segregation of play 
groups at the primary grade level, and 


D BY OPPCSITE SEX 


TUDDENHAM 
SCORES ON THE REPUTATION TEST 


GE ОР TOTAL VOTES гасы OPPOSTE ste ex 


READ D. 


PERCENTAGE OF TOTAL VOTES гады Saut sex 


PERCENTA: 


PERCENTAGE DETERMINATION BY SAME SEX ANI 
OF BOYS’ AND ОЕ GIRLS' 


18 


x aiia: E 
a 3 "E. Б 
2ESSSSSSI e $ о Ы о 
B E H 
> a | 3E = si 
с, БЫ уу о 28 о БЕ 
E + Н 
832899855 888893323& EO ETE ETE LER 
х х х 
anaa 
ESSSSSSSSJ = о ы а 
5 H ° 
5 Н z е ô 
23 БЕ TONY = g st 
a ae & 53 
& “KS a $ 
EXEKEEEEEE MM 
x . 
ЕЈ 
3 Н Fa 
Е À BA WG a LJ 
ә Ы Ш о 5 ° 
5 3 t 
на bad X o NSS = $8 
9 Ы ` + SS Р o a8 
ӯ 8 А 
2 SI 8 $ 
3 SS | 
S 2 
8889939389? "B 558888998890 889gP9398289^ 


2 INS 


17 
m АТ GAMES - GOOO AT Games, 
7i 
а 
8 68 ов 
25 
BEST FRIEND 
4 
в св 68 
33-32 
UNTIDY - Troy 
d 


У SSG 
ESSI 8 у о 
583393393859 FEXKEEEKEEEEEE 88818393899 
е х 


„ 


‚5ЕХ AND GRADE DIFFERENCES IN CHILDREN'S EVALUATION OF PEERS 19 


in heterosexual inte:est at the beginning 
of adolescence. 


С. SUMMARY OF CHAPTER III 


Scores for children on each item-pair 
were derived by algebraic summation of 
favorable and unfavorable mentions and 
corrected for differences in the size of 
the classrooms. Distributions of these 
Scores were found to show a considerable 
piling up of zero scores. However, the 
proportion of children receiving a defi- 
nite characterization on one pole or the 
Other of a dimension increased with 
grade level, and on the average item- 
pair only one child in five received a 
‘score of zero. 

. Children’s attitudes toward each other, 

sa Insofar as they can be inferred from the 
mean score of girls and of boys on each 
dimension, seem to have been anticipated 
quite accurately and succinctly by the 
х famous nursery rhyme about little girls 
being made from sugar and spice, and 
little bovs from snakes and snails. More 
Specifically, the typical girl is judged to 
be Quiet, Poruran, FuLL or Fun, Nor 
QUARRELSOME, А Соор Sport, A LITTLE 
Lapy, Goop-Lookinc, МОТ A Suow-Orr, 
Troy, and Frienpiy. The typical boy is 
Wiccry, QUARRELSOME, Bossy, and a 
Suew-Orr. On the favorable side of the 
ledger he is inclined to TAKE CHANCES, 
and be Nor Basurur, Соор AT GAMES, 
and a ReaL Boy. On most of the remain- 
Ing qualities covered by the test, girls 
enjoy more favorable status than boys, 
though to a less extreme degree. 

Age differences in mean scores tend to 
be less significant than the sex differ- 
€nces cited above. However, a trend with 
increasing grade level for girls to lose 


status and for boys to improve, operates 
to reduce the magnitude of the sex dif- 
ferences. No hypothesis is advanced to 
explain the drop in girls’ scores, but 
the improvement noted for boys is prob- 
ably in part the result of the reluctance 
of the older judges to make characteriza- 
tions of each other on the unfavorable 
items. 

Both boys and girls receive their scores 
primarily from individuals of their own 
sex, and this tendency grows slightly 
more marked with age. However, girls’ 
scores are in the first grade determined 
by boy judges to a relatively greater de- 
gree than are boys’ scores determined by 
girls. This trend disappears around the 
third-grade level, and is replaced in the 
fifth grade by a tendency for girls to 
contribute more heavily to boys’ scores 


than vice versa. 
At all three grade levels studied, votes 


on the item BesT FRIEND are received 
almost exclusively from children of the 
same sex as the person named. 

The picture of the typical boy and 
girl as conceived by children even in the 
primary grades seems to be almost a 
photostat of the common identification 
by adults in our society of aggressiveness, 
restlessness, and daring with masculinity, 
and of amiability, docility, and timidity 
with femininity. Perhaps equally signifi- 
cant for the theory of adult personality 
organization is the fact that especially 
in the lower grades the traits associated 
with girls tend to be positively valued, 
while many of the traits associated with 
boys are disapproved, a situation which 
may have important implications for the 
attitudes of adult men and women to- 
ward themselves and toward each other. 


CHAPTER IV 


PATTERNS IN JUDGMENT 


HE Reputation Test yields data of 
JT. Sorts about each child: first, the 
judgments others make about him, i.e., 
his "reputation," and second, the judg- 
ments he makes. Normative findings of 
the first sort have been considered in 
the previous chapter. In the present one, 
the frame of reference will be inverted 
and findings presented on the character- 
istics of boys and girls of various grade 
levels as judges of others and of them- 
selves. Data on teachers’ judgments of 
their classes wil] also be included here, 
because they provide a contrast to the 
children’s judgments both as to items 
avoided or emphasized in voting, and 
as to the identification of certain attri- 
butes with masculinity and femininity. 
Some of the results have been anticipated 
in the last chapter, Owing to the recipro- 
cality between group patterns in votes 
received and in votes given. However, in 
the present chapter, analyses of judg- 
ments will be based on individual items 
rather than item-pairs, and patterns con- 
cealed or obscured by treatment in terms 
of item-pairs will emerge more clearly. 

Several Purposes are seryeg by this 
analysis. First, results may be used asa 
guide to the selection and phrasing of 
test items, the choice of optimal test 


of their own Personalities, 
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А. CHILDREN'S JUDGMENTS OF 
EACH OTHER 


In Table 6 are given the mean num- 
ber of votes cast by boy and girl judges 
for members of their own and of the 
Opposite sex. Since judgments are de- 
manded on individual items, the data 
have likewise been so analyzed, and 
favorable and unfavorable traits have 
been Segregated in this table. The origi- 
nal order of presentation of the ques- 
tions is indicated by the item number, 
save in the case of Brsr Frienp, which 
Was always given last. Self-mentions arc 
not included in this table, nor is any 
correction made for variation in the size 
of the classrooms, since the number of 
others mentioned by a child on a given 
item was hardly ever more than a frac 
tion of even the smallest class. Althogh 
instructions were Phrased so as to permit 
the children to name as many others on 
each question as they felt merited the 
description, there were few traits on 
which the average child mentioned as 
many as three persons, The modal num- 
ber of votes per child on each item was 
one in most cases, However, the distribu- 
tions are all noticeably skewed since it 
was not uncommon for a child to men- 
tion as many as eight or ten others on a 


few items which had Special significance 
for him. 


1. Grade Differences in Judgments 


As may be seen from Table 6, the 
mean number of votes cast per child оп 
any given item does not vary greatly from 
8'ade to grade; nor is there any con- 
sistent trend, the average for all items 
dropping ‘rom Grad» I to Grade IL 
and increasing from Grade III to Grade 
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{ ТАВГЕ 6 


MEAN NUMBER ОЕ Votes Cast PER JUDGE ON INDIVIDUAL ITEMS 
OF THE REPUTATION TEST 


Grade I Grade III ! Grade V 
Ga Judges Bey Judges 
Girl Judges | Boy Judges | „ы ЗУ, | s 93%) | Girl Judges | Boy Judges . 
fien (=) Qv-6s Rer | олз 2525) | (200) 8255 
items 26-31) | items 26-31) 
Votes | Votes | Votes | Votes | Votes | Votes | Votes | Votes | Votes | Votes | Votes | Votes 
For | For | For | For | For | For | For | For For | For | For | For 
Girls | Boys | Girls | Boys | Girls | Boys | Girls | Boys | Girls | Boys | Girls Boys 
Unfavorable Items | 
1 WicGGLy ES 2.2 4 1.7 4 | Ter +3 r.a :6 | 1.4 1.4 
4 Nor Many FRIENDS 4] ug «4 | i-a .6 i8 +3 | го | 2.3 8 1.0 
6 SERIOUS .6 т.о 4 Xd .6 `$ 4 7 1.2 .6 -9 
7 QUARRELSOME 3 1.7 +3 1.8 E TII E 1.4 1.2 .8 1.5 
9 Dorsn'T TAKE CHANCES 8 ө .6 1.0 :5 +3 4 -5 1.5 +3 Tis 
11 Bossy .6 E 1.2 | 1-0 $ +3 p 57, 8 т.б 
13 Poor Sport У 4 | r2 ` 2 | or. ‘ à І.4 
15 BASHFUL 3 .6 .8 .6 .2 4 :5 r$ ET б 
18 Nor Соор At GAMES v4 4| r2 1 6 s^. Ee rs 4 2 NS 
9 GETS Map EASILY " E 1.4 . L +2 * . . . E 
21 Sissy E =: 1.3 — 1.3 — 1.0 = I.4 = 1.3 
23 Tomnoy 1.0 — 1.0 — -$ — .° — 1.8 — 1.5 — 
27 Nor Goop-LookiNG i 4 E IN i ui 7 gs 
28 Snow2Orr . E +3 Hi “3 3 at 
31 Nor A LEADER E C “т ef us à 
33 Untipy u =e к mn 
34 FiGurs то з la 18 
37 Nor FRIENDLY 19 2 5з 18 
39 CAN'T TAKE А JOKE 
e 
Avg. Votes per Item per J. P 
(Unfav.) 2 g| aaj 5| rs] 6] -6]| 3| э r2] m] o | ta 
Tas i 
Favorable Items = 
2 Ошкт © 1.7 18 | azex | ees 8. 3 о E. ao 4 
3 POPULAR LAN ENCEINTE IPS: 
5 Fut or Fux ЕА Е || ias 
8 Nor QUARRELSOME 1.8 +6 у жазы S st hrs | т.406 
10 TAKES CHANCES 1.0 “7 5 1.7 а x 
.8 1.8 v3 
12 Nor Bossy 1.0 E “| ж 55 +5 
14 Соор Sport 1.5 -ó +6 | 1:8 ae di n ae 12 
10 Nor BASHFUL 1.2 -7 4 | r$ HA 3]| 1.8] 2.0 | ro 
17 GOOD AT GAMES 1.2 8 CREE Ex $|zro|zo| .4 
20 Doesn't Ger Map Easity | r.2 | 8| -4 | rr| 1-4 = | zo | — | 2.9 
22 REAL Boy — fup [te To 
Р , E т — 2.4 T» 
24 Acts Like LITTLE LADY a8? == | aa = | 5 PESE т.д e 
25 Best FRIEND т.2 of 3 | 12 eee Es 7 SS {17 7 
26 Goop-LookixG ri i a.a [or ee 
29 Nor a Snow-Orr `8 nj ia |5 4 
30 LEADER E E 
2.6 E 
32 Тү I.4 m 
35 Dorsw'r Figur 2.2 .2 
30 FRIENDLY HE m 
38 TAKES д JOKE on SELF : 
Avg. Votes per Item per J. ri 1.9 7 6 | 1.7 
Кауог.) т.4 .7 8 | 14 | 1.3 5 Е 
Avg. е E : 6 5 1.4 
(5 etes ner Item per J. cx Ка} "TT ET. 6 4 | xe 7 Pus 


V. The Grade I results are based on rela- 
tively few cases and are hence, less ac- 
Curately determined. The increase 1n 
Mean number of votes per item between 
Grades III and У тау be as much the 
result of a change in the ihode of test 


administration, as of a true age differ- 
ence in the subjects’ voting habits. (It 
will be recalled that fifth graders voted 
more freely on uncomplimentary items 
when they wrote them down, than when 


they yerbalizee them to an interviewer.) 
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Although age differences in volume of 
voting over the test as a whole are not 
marked, there is considerable variation 
among items at all grade levels. Inspec- 
tion of the data shows that the most- 
used items tended to occur near the 
beginning of the test, while the least- 
used items occurred near the end where 
the children were hampered by fatigue 
or lack of time. At all grade levels the 
last item in the test was in the least- 
mentioned group. (In the fifth grade the 
item Brsr FRIEND actually came last in 
the booklet, but children were requested 
to fill it in five minutes before the end 
of the period and then go back and 
work on the others.) 

A second factor, perhaps even more 
important than fatigue in limiting the 
volume of voting, was the tendency of 
the child judges to avoid making un- 
complimentary nominations. At all three 
grade levels the four most often men- 
tioned traits were favorable, and of the 
four least often mentioned traits, all but 
Brsr Frienp (Grade I only) were yn- 
favorable. This tendency grew more pro- 
nounced with older children. Taking 
all dimensions together, the average criti- 
cal ratio of the difference between the 
mean number of votes per positive item 
and the mean number of votes per corre- 
sponding negative item was 1.97 in the 
first grade in favor of the positive pole. 
In the third grade the same statistic in- 
creased to 5.39 and in the fifth grade to 
7.09. Only a very few negative items, 
Bossy, Gers Map, QUARRELSOME, and 
Suow-Orr, elicited more voting than 
their positive antonyms and in such cases 
none of the critical ratios of the dif- 
ference between negative and positive 
means was statistically significant. Ap- 
parently, the children reversed their 
tendency to avoid mentioning others as 


having undesirable“ traits only with re- 
spect to a few relatively innocuous items. 
For example, the items SHow-Orr and 
Bossy are correlated with LEADER and 
Takes CHANCEs and hence carry much 
less opprobrium than items such as Sissy 
and Nor Many Frienps. It is unlikely 
that undesirable attributes are actually 
as much rarer or as much more difficult 
to observe as these findings would im- 
ply, especially since in many cases thc 
undesirable item refers to more specific 
behavior than the desirable ene, and 
since only the relatively more extreme 
children were to be cited at either end 
of the scale; but the socializing process 
to which children in our culture are 
subjected seems to have led them éven in 
the first grade to regard the making of a 
formal statement uncomplimentary to 
someone else as a violation of the mores. 


2. Sex Differences in Judgments ,, 


Considering the test as a whole, there 
is a slight though consistent ‘tendency 
for girls to cast more votes than boys at 
all three grade levels studied, a trend 
that increases with grade level. In the 
first and third grades the trend is small, 
but by the fifth grade, the average critical 
ratio of the difference between the mean 
number of votes by girl and by boy judges 
for all items together is 3.0, and on many 
individual items the critical ratios are 
much larger. At no grade level was there 
an item which elicited a significant dif- 
ference in volume of voting in favor of 
the boys. The Reputation Test as used 
in this investigation contains numerous 
items such as Ficnrs, GOOD at GAMES, 
Takes Cuances, etc., which it had been 
felt might overload the test with ques- 
tions about behavior which may be more 
characteristic of boys and possibly more 
easily observed by them. However, so far 
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as vote casting is concerned, the girls 
clearly lead the boys, a finding which has 
been reported by Campbell (1) and 
Tryon (10) for an older age group. Pos- 
sible explanations are that a difference 
in motivation to take the test exists, that 
girls are more interested than boys in 
social relationships, or that girls are able 
to verbalize their observations of others 
more readily. 

Further questions of interest 
Whether girl and boy judges differ in 
the degree to which they express opin- 
lons about members of the opposite sex, 
whether boy and girl judges tend to give 
more favorable mention to members of 
their own or to members of the opposite 
sex, end whether there are certain items 
on which judges of both sexes vote pri- 
marily for one sex to the exclusion of 
the other. 

, The first striking fact to be observed 
15 that, in general, children vote much 
More heavily for persons of their own 
ren pe or e GRE 


are 


9 
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tive and negative aspects of reputation, 
save in the case of first-grade girls, who 
voted more heavily for boys on unfavor- 
able items. However, there exists an 
amusing difference between the voting 
habits of girl and boy judges. At all three 
grade levels, boys cast more favorable 
than unfavorable votes, both for their 
own and for the opposite sex. Girls cast ` 
more favorable than unfavorable votes 
for their own sex, but more unfavor- 
able than favorable votes for the opposite 
sex. Table 7 shows this clearly. Especially 
in the first grade, but to a lesser degree 
throughout the elementary years, the 
unwillingness of children to make nega- 
tive judgments about each other does 
not extend to girls’ opinions about boys. 
By inspection of Table 6, it is possible 
to locate items which both boy and girl 
judges consider to be more character- 
istic of boys and other items which are 
more frequently applied to girls In 
Grade I, both boys and girls voted more 
heavily for boys on all the negative 
items. In Grade III, both sexes men- 
tfoned more boys on WIGGLY, QUARREL- 


I n 
Pell, and has been found in the present eges 
Investigation to hold true for both posi- SOME, Poor Sport, and Nor MANY 
Y 
TABLE 7: 
S AVERAGE VOTES PER ITEM BY Boy AND GIRL JUDGES 
: FOR SAME AND OPPOSITE SEX 
Grade I Grade Ш Grade V 
Type of Vote Unfavor- | Favor- | Unfavor- 
avor- Unfavor- Favor- nfavor- а 
p able able able able able 
Boy Judges: 
Avera, у Judges: 
е e: = 
boss veteaiper леш I.4 1.3 fox .9 1.4 r2 
Avera, 
age vot i | 
or girls otes per item E E E - F li 
Girl Judges: 
Averag ttt Judges: 
age у, i 
or girls otes per item € " е7? 4 xi T 
Average voti ^ = 
к е 
ог boys s per item a T Р 6 » " 
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FRIENDS, and more girls on Goop-Loox- 
ING, QUIET, and Nor A Suow-Orr. In 
Grade V, both sexes mentioned more 
boys on WiccLv, SHow-Orr, Unrtipy, and 
Ficuts, and more girls on Goop-Look- 
ING and Quier. Additional items on 
which boys voted for boys to a greater 
degree than girls voted for girls are 
Takes CHANCES, Goop AT GAMES, and 
LEADER. The consistency with which 
traditionally masculine and feminine at- 
tributes are so identified in the primary 
grades is impressive. 


B. CHILDREN’S SELF-EVALUATIONS 


In Table 8 are presented data on the 
percentage frequencies with which boys 
and girls mentioned themselves on the 
various favorable and unfavorable items 
on the Reputation Test. The item Brsr 
Frienp is omitted from this table, al- 
though in the course of the entire test- 
ing program several either unusually 
frank or.unusually flippant children so 
named themselves. In no case did a 
child mention himself on opposite poles 
of the same dimension. 

The most striking feature of Table 8 
is the very much greater frequency of 
self-mentions on positive items than on 
negative ones. This finding holds true 
both for boys and for girls and at all 
three grade levels studied. On only a few 
negative items did children name them- 
selves more often than on the correspond- 
ing positive traits, and such instances 
were in most cases relatively innocuous. 
The unfavorable items on which girls 
named themselves more often than on the 
paired favorable traits are: WuiccLy 
(Grade III), and Basurur, Томвоү, and 
Nor Соор-І.оокімс (Grade V). Such 
items for boys are: Wiccty and Nor 
Goop-LooxiNc (Grades III and V). 


Although positive self-mentions were 


more frequent than negative ones at all 
levels, the number of children making 
self-mentions on the average favorable 
item decreased from around 28 per cent 
in Grade I to around 22'per cent in 
Grade V, while the number making un- 
favorable self-nominations increased over 
the same range approximately from 8 
per cent to 9 per cent. This trend ob- 
tained among children of both sexes. On 
many individual items, the difference in 
frequency of self-nomination at adjacent 
age levels in accordance with this trend 
is highly significant (C.R.'s > 3.0). 

In comparing self-evaluations with 
similar tendencies in judging others, one 
notes that judgments of both types are 
more frequent on favorable than or. un- 
favorable items. However, the tendency 
of favorable self-judgments to decline 
with grade level while unfavorable self- 
judgments increase, stands in striking 
contrast to the children's age trend in 
judging others to avoid more and more 
the seriously derogatory mentions in 
favor of the complimentary ones. 

Social learning may well be responsible for 
both situations. In judging others, there seems to 
arise in older children an unwillingness to ex- 
press criticism or hostility too frankly. In judg- 
ing themselves, the children appear not only 20 
have grown more capable of detachment, but 
also to have assimilated at least in part the 
taboo which society places upon too obvious self- 
congratulation. Nevertheless, it is probably in- 
accurate to assume that the younger children 
who named themselves for favorable traits always 
felt that they really possessed them, or that thc 
decrease in such mentions necessarily reflects an 
increase in modesty. Analysis of the records of 
individuals indicates that probably many com- 
plimentary self-mentions of first graders were 
made with reference to areas in which they felt 
insecure and were moved to "protest too much." 
Older children came to avoid making favorable 
self-mentions on the dimensions on which they 
feared that class opinion would be discrepant, 


but only rarely named themselves for qualities 
seriously disappfoved by the group. 


Referring again to Table 8, one may 
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| ТАВГЕ 8 
PERCENTAGE FREQUENCY OF CHILDREN's MENTIONS OF THEMSELVES 
ox IxpivipvAL ITEMS OF THE REPUTATION TEST 
Е Grade I Grade III GHEN 
Girls Boys 
(N 7318, | (N=336, 
Item Girls Boys um A Girls Boys 
(N 241) | (N=65) (= 260, | (N 9184, (N 2296) | (N 2 312) 
items items 
26-31) | 26-31) 
н We orale Items 5% 5% 1196 18% 5% 14% 
4 Nor Many FRIENDS 2 2 Ф H И 5 
SERIOUS 5 6 р 8 8 8 
7 QUARRELSOME 9 $ 6 4 ы, 16 
9 Dorsy’t TAKE CHANCES 5 o 2 4 7 
11 Bossy o 3 E 4 5 
13 Poor Sport o 3 2 * 35 17 
15 BASHFUL 5 8 d a 15 13 
pal < ә 
18 Nor Соор ar GAMES 5 3 9 9 її то 
19 Gers Map EASILY 2 5 IN 2 3 
21 Stasy o 38 
23 Томвоү 2 18 7 10 8 
27 Nor Goop-Looxixc y 8 H E 
28 Ѕноҳу-Оғр ix 8 7 
37 Nor a LEADER 3 2 6 
33 Untipy 4 10 
34 Ficurs o 3 
37 Nor FRIENDLY I Que. 
39 CaN'r Take A JOKE % 8.2% 
8.0 9.796 |. 8.2% 
Mean (Unfavorable Items) 2.8% 4-3% 6.9% Кш 
10 6% 
" Quis" 29801 Items 22% 2986 8% пш °% 29 
3 Popurar "20 15 21 5 27 21 
5 Fur, or Fu 15 22 33 3 EA 23 
8 No N 32 48 49 o зо 
i Т OUARRELSOME 37 21 44 A 
9 TAKES CHANCES 22 45 35 * 23 21 
?.Nor Bossy 22 1% > 44 23 де 
4 Соор Sporr 27 37 5j 33 29 z 
16 Nor BASHFUL 24 28 e E 22 34 
Fu Соор Ar Games 24 43 2 33 19 a 
4 ee Сет Map EASILY 29 = ij 55 xe £ 
24 Ас ov 28 
26 Acts Like LITTLE LADY 24 7 3 8 a 
29 Soop-Looxixo 2! 17 d E 
jo A ОРЕ г; Sg 28 19 
32 Tmy 32 33 
35 Dorsy’ 17 
36 Miro Dum 38 35 
$ 
TAKES А ]окЕ on SELF % | 33 1% | 21.196 | 23 4% 
г 24.140 * 
Mean (Favorable Items) 24.2% | 321% 20.6% | 15:4% | 15.8% 
Mean (Atl Items) 13.8% | 18-2% | 15:5% 
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observe a fairly constant tendency for 
boys to vote for themselves more fre- 
quently than do girls, whereas in voting 
for others, the girls made more nomina- 
tions. The average differences are small 
but are consistent save in the case of 
unfavorable items at the fifth-grade level, 
on the average of which 9.7 per cent of 
the girls mentioned themselves and only 
8.2 per cent of the boys. On individual 
items referring to both sexes, there are in 
Grade I no statistically significant sex 
differences in the percentage frequency 
of self-mentions, but in Grades III and 
V the boys lead by a significant margin 
on several items, including Соор ar 
Games, WicGLv, Suow-Orr, and Ficus. 
On no item save BASHFUL (Grade V 
only) do girls make significantly more 
self-nominations than boys. 

Whether boys are genuinely as much 
more egocentric as these results imply 
is a debatable question. However, the 
fact that the differences between boys' 
and girls’ voting, both for themselves 
and for others, parallel the differences 
between first-grade and fifth-grade pàt- 
terns for the combined group of judges 
of both sexes, suggests that girls are ex- 
hibiting a somewhat more mature type 
of evaluation. 


C. TEACHERS JUDGMENTS OF CHILDREN 


It will be recalled that in order to 
secure a measure of adult opinion about 
children expressed in the same form as 
the children’s opinions of each other, the 
interviewers gave to the teacher of each 
classroom the same Reputation Test 
taken by her pupils. Unfortunately, the 
number of teachers included was too 
small to render their statements a sta- 
tistically adequate basis for generaliza- 
tion. Further, in this grade range, each 
class had but one teacher for all sub- 


jects. Since all the teachers were women, 
it is impossible to know to what degree 
their opinions would have coincided 
with those of an equal group of male 
adult observers. Nevertheless, this body 
of data, when compared with that sup- 
plied by the children themselves, reveals 
interesting and suggestive differences be- 
tween adult and juvenile points of view. 

In Table 9 are presented the results 
of the voting by teachers. Findings are 
given here in terms of the percentage of 
boys and of girls mentioned by their 
teachers on each item. 

Like the children, the teachers voted 
more frequently on complimentary than 
on uncomplimentary items. This finding 
is true of mentions of both boys and 
girls and at all three grade levels studied, 
but the actual frequencies of teachers 
votes are so low that the difference 5 
probably not significant, On a few di- 
mensions the teachers voted slightly more 
heavily on the unfavorable trait than on 
its favorable antonym. Among these are 
Wiccry (for boys, all grades), QUARREL- 
SOME (for boys, Grades III and V; for 
girls, Grade I), Gers Map Елѕпу (for 
boys, Grades III and V) Ficurs (for 
boys, Grades III and V), and DorsN'T 
ТАКЕ Cnances (for girls, Grades III and 
V). Save for the last, these items all refer 
to behavior which disrupts classroom 
routine, and to which teachers are in 
consequence sensitized. It will be те 
called that among the few unfavorable 
items upon which the children men- 
tioned others more frequently than on 
the corresponding desirable traits, BossY 
was the only one appearing at all grade 
levels, and їп upper grades the items 
Grrs Map and QUARRELSOME dropped 
out in favor of SHow-Orr. The item 
Wiccrv, which elicited so many votes 
from teachers, did пос appear at all 2" 
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| А TABLE 9 
PERCENTAGE FREQUENCY OF MENTIONS OF CHILDREN BY TEACHERS 
ox INDIVIDUAL ITEMS OF THE REPUTATION TEST 
Е Grade I Grade IIT | Grade V 
Girls Boys 
(N=340, | (N 7352, . 
Items Girls 's items items Girls Boys 
(N249 | (779 T 25), gk (N= 306) | (N 322) 
[= 175, | CV = 194 
items items 
26-31) 26-31) 
Unfavorable Items 
I WiccLy 8% 16% 7% 13% 4% 13% 
4 Nor Маху FRIENDS 4 то 4 б 5 6 
6 SERIOUS 10 9 7 6 7 5 
7 12 б б ІІ 5 тї 
ol :8 то 7 5 3 М 2 
10 9 9 6 6 7 
o 4 2 9 ї А 
15 BAsurun 12 10 7 7 9 
18 Nor Goop at GAMES 10 7 5 б d б 
I9 Gers Map EASILY 6 9 3 E i 8 
21 Sissy ^O II 5 " 
23 TOMDQY 6 7 В A " 
7 Nor G z ZING 3 
28 5102 брор LOOKING 5 9 2 9 
21 Nora l 6 Li ] 7 
33 Untipy 7 
34 Ficurs i 4 
37 Nor FRIEN 3 4 
32 Can't TAKE A JOKE 
5 7.2 4.7% | 6.670 
Mean (Unfavorable Items) 8.0% 8.9% 5-5% зай | VES = 
Е: гога ams 
2. Dots ivorable Items 16% o% 18% 10% ae we 
3 POPULAR 18 10 II B 0 9 
5 FuLL or Fux 12 19 9 7 15 7 
8 Nor QUARRELSOME 2 19 7 6 2 5 
to TAKES CHANCES ay 24 T 10 9 
19 Nor Bossy a2 7 4 m. тї 7 
4 Соор Sport 4 7 > 8 
16 Nor BASHFUL 8 19 Es E: б 13 
37 ,Goop AT GAMES 10 ДЕ К 7 тї 7 
о Dorsx'r Ger Map EASILY 22 13 12 14 
28 ReaL Boy 23 - 13 
a Acrs LIKE LITTLE LADY 8 1б. то 8 3 
G ма 6 
5o N9OD-LookING то $ 9 
9 Nor a Suow-Orr 10 12 8 7 
3° LEADER 13 7 
= Tuv 2 5 
33 Dossw'r Ficur 9 7 
E FRIENDLY 6 4 
38 TAKES ЈокЕ on SELF | ug % 7.6% 
8. 9.270 7 0 
Mean (Favorable Items) 11.5% 13.0% 9-476 " ^ " " 
8.0 7-070 7.170 
Mean (АП Items) 9.7% 11.0% 1-4% 2 — 
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the group of negative items on which 
children voted more than on their favor- 
able antonyms. It is of course possible 
that the children voted relatively less 
than the teachers on such items as FIGHTS 
and QUARRELSOME because of their gen- 
eral reluctance to make unfavorable 
characterizations of each other. But since 
these items, at least for boys, have posi- 
tive correlations with Rear Boy, Соор 
AT Games, and LEADFR, this explanation 
seems inadequate. More probably the 
discrepancy between the relative em- 
phasis by teachers and by children of 

‚ certain items reflects a difference in 
their points of view as to which aspects 
of child personality are seriously un- 
desirable. 

The percentage of children named by 
the teacher shows a consistent decline 
over the range from Grade I to Grade 
V. This is true both of the average com- 
plimentary item (approximately from 12 
per cent to 8 per cent) and of the aver- 
age uncomplimentary item (арргохі- 
mately from 8 per cent to 5 per cent), 
but probably signifies no more than that 
the higher grade classes were larger. On 
individual items, grade-level differences 
are in most cases small. This finding is 
to be expected, for although adult ob- 
servers have long noted behavioral dif- 
ferences between older and younger 
children, it must be remembered that 
these teachers were forced by the nature 
of the test to rate children on a relative 
rather than an absolute basis, and had, 
moreover, probably derived the subjec- 
tive standards in terms of which they 
made their judgments from children fall- 
ing within a narrow age range. Selecting 
items on which there is at all three levels 
a consistent difference in favor of one 
sex (irrespective of the statistical signifi- 
cance of the difference), one discovers 


that boys are more, often mentioned by 
teachers on the items WiccLv, Nor 
Many FRIENDS, Poor Sport, Gets MAD 
EasiLv, TAKES CHANCES, and Соор AT 
GAMES, while girls are more often men- 
tioned on the items Serious, DOESN'T 
Take CHANCES, Quiet, and Dorsn’t GET 
Map. The parallel between these results 
and those based on children’s judgments 
is close, though there is less of a tend- 
ency among teachers than among chil- 
dren to assign all the favorable qualities 
to girls and their negative antonyms to 
boys. 
D. SumMary or CHAPTER IV 


In this chapter the data have been 
analyzed in order to reveal characteristic 
patterns in (a) children's judgments of 
other children; (b) children's judgments 
of themselves; and (c) teachers' judg- 
ments of children. Marked differences 
in the volume of voting on different 
items were discovered in all three types 
of judgment data studied. With some 
exceptions both teachers and children 
made more nominations on favorable 
than on unfavorable items. 4 

Grade-level comparisons of the volume 
of voting over the test as a whole did 
not show consistent trends, either with 
respect to self-mentions or mentions of 
others. However, the children beceme 
with advancing grade level more and 
more disinclined to name others as 
possessing seriously disapproved traits, 
whereas they tended to alter their judg- 
ments of themselves in the opposite direc- 
tion (although even in the fifth grade 
favorable selfnominations were much 
more frequent than unfavorable ones). 
Teachers’ judgments were not signifi- 
cantly influenced by the age of the sub- 
jects judged. 

Sex differences in judgment patterns 
were noticeable. Girls voted more for 
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Others, but boys voted more for them- 
Selves. Also, girls cast more favorable 
Votes for other girls than boys cast for 
Other boys, but girls gave less favorable 
selÉevaluations than did the boys. The 
latter difference between girls and boys 
15 similar to that between older and 
Younger children, and suggests that girls 
аге more mature in their habits of judg- 


than are boys of the same grade 
evel. 


x. Children tend to cast considerably 
Оте than half of their votes for mem- 
ers of the same sex. However, certain 


qualities tend to be identified with boys 
and others with girls by all groups of 
informants. Boys are customarily identi- 
fied on such items as WIGGLY, QUARREL- 
some, Ficus, and Suow-Orr, while girls 
are more often mentioned as Quiet, Nor 
QUARRELSOME, and Goop-LooxiNc. When 
children mention themselves, they tend 
to do so on items which are correlated 
with popularity for that sex—the girls 
choosing items connoting docility and 
amiability, the boys those connoting dar- 
ing and sportsmanship. 


CHAPTER V 


AGREEMENT AMONG JUDGES ON THE REPUTATION TEST 


HE Reputation Test is essentially a 
lbs for obtaining personality 
ratings of a child concurrently from 
many judges—from his classmates, from 
his teacher, and from the child himself. 
The judgments of these various inform- 
ants reflect different frames of reference, 
and the determination of the degree to 
which the judgments are mutually con- 
gruent is of considerable theoretical and 
practical interest. In this chapter are re- 
ported findings on the agreement with 
which classmate judges characterize each 
other, and on the correspondence be- 
tween pooled opinions of classmates and 
judgments from the special points of 
view of the teacher and the child himself. 


A. AGREEMENT AMONG CLASSMATES 


Perhaps the simplest index for evalu- 
ating consistency in judgment among 
classmates is the correlation between 
reputation scores on a given trait based 
on pooled judgments from a random 
half of the class and scores from the other 
half. A correlation of this type has been 
referred to by some investigators as the 
“reliability coefficient” of the trait con- 
cerned, a usage which has been avoided 
here because the term has also been 
applied to such distinct aspects of the 
test as the degree of overlap among the 


component items, and the temporal con- 
Stancy of scores. 


In point of fact, it has been shown that reputa- 
tion testing compares very favorably with other 
types of rating procedures in "reliability" by 
either of the latter definitions, 

Hartshorne, May, and Maller (3) reported for 
à group of fifth and sixth graders a correlation 
ОЁ .88 between half the items of a test of "altru- 
ism" and the other half. Their procedure was 
inappropriate in the present instance since our 
test was designed to tap as many different dimen- 
sions of reputation as possible. 


Symonds and Jackson (8), whose test was de- 
signed to measure “adjustment” secured a retest 
correlation over a four-month interval of .64 
using ninth graders as subjects. “Tryon (10), 
using a test comparable to ours for a population 
of seventh graders, reports retest coefficients over 
а ten-day interval for different traits. ‘These 
ranged between .45 and .95, only six out of forty 
being less than .65 and half of them being 
higher than .80. In the present investigation, sys- 
tematic retestings were not feasible, However, 
correlations obtained for one fifth-grade class be- 
tween individual test and group test scores on 
the various dimensions of the test averaged .77 
over a two-month interval. (See above, Chapter 
II, B.) 

In evaluating these findings, it must be Tee 
called that retest coefficients on the Reputation 
Test are likely to be attenuated not ошу by 
temporal shifts in judgment such as affect all 
rating devices, but also by the sensitivity of the 
test to changes in the composition of the class 
group. For example, if at the first administration 
the class as a whole designates a given boy as 
most outstanding in sports and in the interval 
between tests a new child enters the class wh» is 
recognized to be an even better athlete, the score 
of the former will drop markedly since he will 
now receive no mention from those jadges who 
make but one nomination cach. Hence, the re- 
peated demonstration of retest correlations аѕ 
high as those cited above indicates that reputa- 
tional status is surprisingly stable, at least over 
intervals of a few wecks or months. 


The procedure used in the present 
Study to measure agreement in class 
opinion was to divide each class alpha- 
betically into two groups of judges com- 
posed of boys and girls in the same pro- 
portion. Correlations were then com- 
puted for each item-pair between scores 
received from one half of the judges and 
those received from the other half. In 
this analysis, the several classrooms at 
each grade level were pooled (necessitat 
ing correction for size of class), but scores 
received by boys and by girls were treated 
separately. The resulting coefficients, СОГ" 
rected by the Spearmaa-Brown formula: 
are presented in Table то. 
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9 TABLE то 
CORRELATIONS BETWEEN х 
АТІ Ы БОГИ PEN Scores RECEIVED FROM ONE HALF or CLASS AND 
ES RECEIVED FROM OTHER HALF or Crass 
— (Augmented by Spearman-Brown correction) 
Grade I Grade III Grade V 
kem ans uova 
m Item-Pair " ^g me 
we j ao ) 1-25) 1-25) Girls Boys 
N=49) | (N 779) | (N =178, | (N — 104. (N 7306) (N =322) 
items items 
| 26-31 26-31) 
2 WiGGLY-QuiE 
S IGGLY-QUIET Bom -59 бт .89 .88 .86 .88 
? ser 'OPULAR E +77 .86 .86 +92 8 
7- 8 Qu Us-F { +46 -49 E К .7I B 
7-15 QUARRELSOME-NOT О ME 157 | +49 12 „82 +82 183 
OESN'T TAKE CHANCES-TAKES CHANCES 230 104 бо 75 173 188 
11-12 Bossv-N. 
кын 3 -Nor Bos: -39 +51 +65 6 ` 
roe Foor Sport-Goop SPORT +65 138 165 EE б 8 
1$; BasteuL-Not BASHFUL E 238 E ko 3 +80 
ка AD Соор Ат GAMES-GOOD AT GAMES E бо -76 -84 з 189 
21-22 $ s Мар EasiLv-DoEsx'r Get MAD E +63 US -67 79 +83 
22 Sissy-Reat Boy +63 «So 188 
23-24 " 
ae Townov = LITTLE LADY E йа 89 
27-25 Bust Friexp ` E 15 +37 :56 vio E 
28-39 Sia Goop-LookixG-Goop-LookING 77 "13 e jq 
31-36 MIN OFF Nor л Suow-OFF +97 74 +78 37 
Nor 4 LEADER-LEADER ser 78 VES ii 
33-32 Untipy~ 
33-32 UxnovT E 
+73 ; 
.62 Ж 
Mean r (“Best Friend” omitted) ыш E e 34 ux Jm 
5' Max. S.E, (ie. S.E. of zero ғ) for correspond- 
ing N's E .12 +05 105 +06 «o6 
_ 107 +07 


ae be expected, the average Cor 
grad on was much the lowest for the first- 
thee data (r = .55), but increased with 
th &rade level of the subjects to -72 in 
Ww. third grade and 81 in the fifth. 
ms the differences were not statistic 
the тынеш there was а tendency for 
high Spawn scores of boys to yield 
th er split-half-of-judges coefficients 
ап those of girls. This should probably 
unu P to the fact that boys re 
show, more negative mentions and hence 
item И greater spread іп Scores: The 
-pairs Poputar, LITTLE LADY, REAL 
bud and Quir tended in most sets to 
mate те greatest concurrence in clas 
манар: opinion, perhaps because score 
abl ability was greatest on these vari- 
‘es. Best FRIEND was the*only item (по 
Pair) for which the correlgt-ons declined 


with increasing grade. This was to be 
expected, since the condition for a high 
т, that all judges name the same indi- 
viduals, would demand in this case that 
children name their most popular ac- 
quaintances instead of their personal 
friends. That a few children nevertheless 
tended to garner a considerable percent- 
age of all votes cast on this item was in- 
dicated by correlations as high as .40 and 
.53 for girls and boys, respectively, even 
in the fifth grade. 

The correlations obtained are rela- 
tively high for a rating device and indi- 
cate a substantial degree of agreement 
among our judges in their identifications 
on the various items. Apparently the 
procedure of using many judges and re- 
questing them to nominate only those 
whom they regard as outstanding com- 
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pensates in considerable measure for the 
youth and psychological naiveté of the 
informants. 


There remains the problem of determining the 
degree of actual disagreement among judges 
which is obscured by the practice of calculating 
a child’s reputation score on a given dimension 
from the algebraic sum of the nominations he 
receives on the positive and negative items of the 
pair. Disagreement in this sense is defined as 
the mention of the same child for the possession 
of both the constituent traits of a dimension, 
Thus, partial disagreement is expressed concern- 
ing a child who receives five votes for Quier and 
two votes for WiccLy, but no disagreement is 
expressed concerning a child from the same class 
who receives three votes for Quier and none for 
WiccLv, although the algebraic sum of +3 is 
the same for both children, Complete disagree- 
ment occurs with reference to children who are 
mentioned equally often for the Opposed traits 
of a dimension and who as a result obtain an 
algebraic score of zero, 

Data on the frequency of complete disagree- 
ment on the average item-pair are presented in 
Table 11. Fluctuations from dimension to dimen- 
sion are not marked, but the item-pairs on which 
the largest percentage of the group remained 
unidentified are naturally those on which score 
variability was least. Approximately one-fifth of 
the children received a score of zero on the aver- 
age item-pair, the percentages rising from slightly 
more than 20 per cent in Grade I to almost 30 
per cent in Grade III, and than falling to les 
than 20 per cent in Grade V. The proportion of 
those with zero scores who were simply not men- 
tioned rises from around 45 per cent in the first 
grade to a high point of 70 per cent in the third 
grade. In the fifth grade, this proportion dropped 
to 50 per cent, though it should have been 
higher still, provided agreement among judges 


improves with age. Eowever, the increased 
volume of voting in Grade V resulted in the 
mention of less deviate children, and concerning 
the proper identification of these, there would 
naturally be more disagreement among classmate 
judges. This interpretation of the trend is in- 
directly supported by the fact that cancellations 
contributed more heavily to the number having 
zero scores on Sissy-RrAL Boy than on any other 
dimension, and on this item-pair voting tended 
to be especially heavy. 

On the basis of our findings, one may state 
that on the average dimension, roughly one child 
in ten is completely disagreed about and a sec- 
ond child is ignored. However, these results are 
not as disturbing as they might scem, since com- 
plete disagreement is more likely to occur when 
a child is mentioned only once or twice on the 
opposed traits. Complete disagreement concern- 
ing a conspicuous child is very rare, and cases of 
children receiving as many as four votes on cach 
pole hardly ever occur. 

An approach to the measurement of concur- 
rence in children's scores which indicates the 
amount of partial as well as of complete dis- 
agreement may be made simply by determining 
for each item the percentage of those mentioned 
for whom no dissenting votes were cast (i.e., for 
whom there were no mentions on the other item 
of the pair). This method is easily applied, but 
has the disadvantage of failing to take account 
of differences in the magnitude of individual 
scores, Children receiving 1 vote and 14 votes as 
WiccLY are given equal weight, provided neither 
receives any votes as QUIET. (Children not men- 
tioned on the item in question would of course 
not be considered to have been identified at all, 
since by the nature of the test a child receiving 
no votes can scarcely be said to have been 
“judged” even to be neutral.) 

The standard of no dissenting votes as a 
criterion of agreement is a very stringent one, 


TABLE тї 


THE INFLUENCE ОЕ CANCELLATION OF FAVORABLE AND UN 
VOTES UPON THE FREQUENCY OF ZERO Scores 


FAVORABLE 


Grade I 


Grade III Grade V 
Category 
Girls Boys Girls Boys Girls Boys 

1. Mean percentage receiving an algebraic 

score of zero (Mean for all item-pairs 

combined) 21% 22% 29% 28% 15% 17% 
2. Mean percentage receiving no mention 12% 8% 21% 20% 8% 10% 
3. Mean percentage receiving no mention © 

оѓ those with an algebraic score of zero ў 

(i.e., line 1./line 2.) $ | 55% | 40% 7396 68% 50% | 56% 
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oo Honzik»and Davis (6) have pro- 
aide даш oe of this criterion to in- 
КБ sere «ыш agreed about" those children 
wha ed mend identified on an item and 
Naturally i s more than one dissenting vote. 
both nes hildren receiving exactly one vote on 
considered T ар the dimension would not be 
BY the at L. зауе met even this criterion, since 
disnprced m definition they were completely 
allowing a ОЕ Actually, the two criteria: (а) 
Bine ee votes; and (b) allowing one 
ever, Ke Nese yield very similar results. How- 
senting Ei eee of cases receiving one dis- 
ES of the E increases by about 15 per cent the 
fication ome concerning whose proper identi- 
Ws aon с was concurrence among judges. 
about" E oe of boys and girls agreed 
DEC M average favorable and the average 
Th oie a“ are presented in Table 12. 

children йй ‚ between half and two-thirds of the 

are agreed about without scrious dis- 


ssent z 
on the average item. Furthermore, agree- 


pu, somewhat better on positive than on 
first-grad а for all groups of subjects save 
to the pa oys. This finding is to be attributed 
Votes es that more favorable than unfavorable 
oys, E cast for all groups except first-grade 
able ее а child's chance of receiving а favor- 
ceiving д lon was greater than his chance of re- 
К тесе unfavorable mention, he was less apt 
is scor е a dissenting unfavorable vote when 
а nube E favorable, than he was to receive 
Unfavor: E favorable vote when his score was 
received, le. A second finding, that boys (who 
agreed ыр! more negative mentions) are 
avorabl, out relatively better than girls on un- 
may b e items and less well on favorable items, 
With accounted for on the same basis. 
rather respect to age trends, agreement improves 
markedly from the first grade to the third, 


TABLE 12 
E OF CHILDRE 


MEAN PERCENTAG 
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but shows no consistent change from the third 
grade to the fifth. One might have expected that 
the degree of concurrence would increase di- 
rectly with the age of the judges, either on the 
assumption that older children are better ob- 
servers or that they are more responsive to class- 
wide stereotypes of attitude. However, the lack 
of consistent improvement from the third to the 
fifth grade suggests that other factors, especially 
shifts in the general proportion of favorable to 
unfavorable voting, were sufficiently important 
to obscure any hypothetical relationship between 
the judges’ accuracy and their age. 

With respect to individual items, there are 
few which are consistently good or bad with re- 
spect to agreement for all groups of subjects. 
However, QUIET, PorULAR, and Соор-1.оокїхс 
and their antonyms, elicit rather consistently 
good agreement, while on another small group 
including Acts LIKE Litre Lapy, REAL Boy, and 
Соор Sronr and their antonyms, the agreement 
is for most groups of subjects relatively poor. 


To summarize: the trends in score 
agreement parallel the trends in mean 
scores themselves. Girls, who tend to 
have more favorable mean scores than 
boys, are agreed about better than boys 
when identified for positive qualities, 
but are agreed about less well when 
identified for negative ones; and, as in 
the case of sex differences in mean scores, 
&x differences in agreement become less 
marked in higher grades. Approximately 
eight children in ten receive a score other 
than zero on the average dimension, and 


N “AGREED ABOUT" ON 


= FAVORABLE AND UNFAVORABLE ITEMS 
Grade I Grade III Grade V 
4 Girls Boys. Girls Boys Girls Boys 

Favorable i 

(No dissent) 4696 28% 57% 50% 55% 53% 
Unfavorable i 

ca ie 27% 29% 43% 48% 3996 45% 
Favorabl i 

(One dissent) 62% 43% 70% 62% 70% 68% 

| $ 

Unfavorable i | . 

(One die e 39% 47% 56% 61% 53% 59% 
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from the third grade on, two-thirds of 
these are identified with substantial 
agreement. Hence, it seems safe to say 
that the Reputation Test yields sufficient 
data to make possible clinical character- 
ization of somewhat over half the chil- 
dren on each dimension, and of a much 
larger proportion on the test as a whole. 


B. AGREEMENT BETWEEN SELF- JUDGA 
AND CLAss OPINION 


The problem of studying agreement 
between self-judgments and classmates’ 
judgments differs from that of analyzing 
concurrence within the pool of class 
opinion and requires other methods. In 
this section “agreement” is said to obtain 
when children not mentioning them- 
selves on an item are not mentioned (or 
are mentioned only infrequently) by 
their classmates, and children mention- 
ing themselves are mentioned by many of 
their classmates. Results have been an- 
alyzed for each item in terms of the 
critical ratio of the difference between 
(а) the mean reputation score from class- 
mates of those who mentioned them- 


selves and (b) the mean score of those 
who did not. 


Biserial correlations were also calculated be- 
tween self-mention vs. non-self-mention and class 
reputation for those items on which at least 5 per 
cent of the children named themselves. Un- 
fortunately the infrequency of self-mention on 
some items not only precluded calculation of 
biserial coefficients, but also produced very large 
standard errors in the mean scores of the sclf- 
mention groups. For this reason a substantial 
absolute difference between self-mention and 
non-self-mention mean reputation score ofien 
failed to yield a significant critical ratio, 


The critical ratio of the difference be- 
tween mean scores of the self-mention 
and non-self-mention groups on 
median item increased with age but was 
low in Grades I and III (4 and 1.3, re- 


spectively), and reached a value of only 


the 
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2.5 even in Grade V. Biserial correlations 
were also low, the median value for 
Grade V being close to „о. Sex differ- 
ences were not marked, although critical 
ratios were slightly larger (indicating 
better agreement) for boys than for girls. 
For both sexes, there seemed to be а 
slight tendency toward better agreement 
on unfavorable items than on favorable 
ones. Although complimentary self-nomi- 
nations were much more frequent than 
uncomplimentary ones, the latter were 
more likely to receive corroboration from 
the class. 

With respect to individual items, there 
were none yielding consistently good 
agreement in all sex-age groups. Nega- 
tive critical ratios (indicative of actual 
disagreement) were not uncommon in 
Grades I and III. Even in Grade V only 
about one-third of the items yielded posi- 
tive critical ratios of 9.0 or more. 

The general conclusion seems clear 
that children are either not very success- 
ful at observing in themselves character- 
istics which the class group identifies, or 
else are inhibited by self-protective mech- 
anisms from expressing in this way their 
true opinions of themselves. In either 
case, self-nominations appear to cen- 
tribute to the individual child's reputa- 
tion record a type of data not duplicated 
by judgments from the classroom group. 


C. AGREEMENT BETWEEN TEACHERS’ 
JUDGMENTS AND Crass OPINION 


Since each teacher had completed the 
Reputation Test upon her own class 
room, it was considered worth while to 
determine not only the quantitative as- 
pects of teachers’ voting patterns, but 
also the degree to which their judgments 
of individuals coincided with those О 
the children in their classes. To this end. 
critical ratios were computed to test the 
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significance of the difference between the 
mean reputation score from classmates of 
those mentioned by the teacher and the 
mean score of those not mentioned. 
Agreement between classmates’ and 
teachers’ judgments was considerably 
Sreater than that between classmates’ 
Judgments and self-evaluations, although 
= cases agreement increased in di- 
. i ationship to the age of the group, 
LA cases agreement was slightly 
sv - hays than for girls (Grades II 
ume y). The tendency toward better 
items Jen with the class on unfavorable 
8 noted in the self-judgment data was 
not found in the teacher-judgment data. 
Р With respect to individual items, 
ү between teachers and class- 
te was highest on traits such as 
'ADER, Bossy, and POPULAR, which the 
emi TUM able to observe in class, 
the © traits such as WIGGLY for which 
ы eachers probably determined the 
attitude of the class. 
a between teacher and da 
crea essed in terms of critical ratios, in- 
мни with grade level from a median 
to 2: of approximately 1.2 am Grade I 
2.5 in Grade Ш and 3.4 m Grade V, 
i corresponding biserial correla- 
Суз reached a value of only .6 even in 
al iiia V. Thus one may conclude that 
€ by ss unum n 
group Ji E identi pau uh 
Möre e ies mean score 15 п n 
not xtreme than that of the pe 
too be identified, nevertheless Ше » 
жы discrepancy between the ce 
ime ^ by teachers and by ped 
Уйна to enable one to predict ай ^ i- 
lis = child's status with the class from 
$ reputation with the teacher. 
ge i connection, it should be € 
ben. that poor agreement does no 
essarily indicate tha? either the 


ass, 


teachers or the classmates are poor ob- 
servers. The children and adults may 
have differed in their interpretations of 
the items themselves, and more impor- 
tant, were forming their judgments in 
different social contexts. For example, a 
significant relationship was 
found between teachers’ and classmates’ 
judgments as to which first-grade boys 
were BASHFUL, suggesting that shyness 
with adults may be a quite different 
matter from shyness with other children. 
It must be remembered that the teach- 
ers’ contacts with the children were usu- 
ally limited to the classroom, and that 
their opportunities to see the children in 
e variety of situations and thus to 
form judgments on many traits, were 
correspondingly curtailed. While the 
children, in neighborhood play, soon 
learned which were daring, good sports, 
the teachers did not, and sometimes 
at on certain items they 


negative 


a wid 


etc., 
complained th 
had had no opportunities to form judg- 


ments. For this reason, it is not surpris- 
ing that teachers and classmates often 
disagree in characterizing individual 


children. 


D. SUMMARY OF CHAPTER V 

have been summarized 
the findings from analyses of the agree- 
ment in characterization (1) among class- 
mate judges, (2) between self-estimates 
and classmates’ opinions, (3) between 
teachers’ judgments and classmates’ 
opinions. 

Correlations between scores received 
from half the classmate judges and scores 
from the other half increased on the 
average item-pair from .55 in the first 
grade to .72 in the third and .81 in the 
fifth, indicating considerable agreement 
among classmates in identifying children 
on the various dimensions of the test. 


In this chapter 
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On the average dimension, approxi- 
mately eight children in ten received a 
definite characterization. Of the two chil- 
dren in ten receiving a score of zero, one 
was not mentioned at all and the other 
received equal numbers of favorable and 
unfavorable votes. Of those receiving a 
definite characterization on one item or 
other of the dimension, about go per 
cent in Grade I and 50 per cent in Grades 
III and V were identified without any 
dissenting votes on the opposed item (al- 
though. the frequencies were increased 
by 10 per cent to 15 per cent if one dis- 
senting vote was allowed). Thus it is 
apparent that the “dimension-score” 
(based upon algebraic cancellation. of 
favorable and unfavorable votes) used 
in many of the analyses presented in this 
report was for about half the subjects 
something of an abstraction from the 
raw data on votes received. However, 
most disagreement occurred in the case 
of children occupying more ог less 
median status in the group, and only 
rarely did children with markedly devi- 
ate scores receive dissenting votes. 

Fluctuations in agreement in boys' 
and in girls scores at the various age 
levels seemed to be in part a function of 
the total number of positive and nega- 
tive votes received by the group of sub- 
jects concerned. 'Thus boys, who received 
relatively more votes on unfavorable 
items, were agreed about better than girls 
on these qualities, while girls were 


judged with more: concurrence on the 
favorable items on which they received 
relatively more votes. 

Agreement between reputation with 
a pool of classmates and self-evaluations 
(measured by critical ratios of the differ- 
ence in mean reputation score of the self- 
mention and non-sell-mention groups) 
was quite poor. Although agreement in- 


creased with grade level, the median’ 


critical ratio even in Grade V was only 
2.5. 

Agreement between classmates’ judg- 
ments and teacher nominations was 
somewhat better than in the case of self- 
evaluations (C.R. of median item in 
Grade V — $.4), but the teacher and the 
class often disagreed as to which’ indi- 
vidual children were most deviate on 
particular items of the test. 

The results presented in this chapter 
indicate that judgments by classmates, 
teacher opinions, and self-nominaticns 
are by no means in perfect agreement 
with each other, However, the records of 
individual children discussed in Part IL 


of this report indicate that such dis- 


crepancies in opinion are themselves 
meaningful. When interpreted qualita- 
tively and configurationally, they make 
of the Reputation Test a richer and 
more sensitive means of diagnosing sovial 
adjustment than would a quantitative 


evaluation of classroom reputation con- 
sidered alone. 


T 
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CHAPTER VI 


SUMMARY AND CONCLUSIONS 


HIS INVESTIGATION of reputation dif- 
ferences was directed toward two 
major goals: first, the discovery of char- 
acteristic sex and age differences in the 
attitudes of elementary school children 
toward each other and toward them- 
eee second, the exploration of the pos- 
ЫП. he the Reputation Test as a 
Kite evice for diagnosing the social 
i ofa -— of individual children. Part 
Шеге his report concerned the first of 
. goals. Findings on group differences 
Presented in previous pages were ana- 
E not only for their significance as 
ed for diagnosis, but also for their 
the E of the social demands to which 
dividual child must adjust. 


A. DESCRIPTION OF TEST 


к test used to explore these prob- 
dren’ was constructed to measure chil- 
ы attitudes toward each other on 
could 05589 of personality which they 
which readily observe in each other, 
tional they could judge without ee 
signif disturbance, and which wene g 
thè Б to the clinician. In form, 
oe фм consisted of pairs of short ques- 
Sidr +‘. item in each pair being te 
the v favorable for adjustment an 
ther unfavorable. Examples are: 
AP) “Which children are good sports 
always play fair?” 
UN "Which children aren't very good 
5, the poor losers?” 


he ch; 
ham Children were asked to supply 
Nes of those of their classmates who 


те thought best fitted each description. 
"ei vere allowed to make as meny 

i ME og as they wished, to a 
ervin if they could think gf no en 
S of g mention, and to name themse” | 
ten as they pleased. The teacher О 


the 


S 
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each class also supplied data in this form 
on her pupils. 


B. PorULATION STUDIED 


The data upon which this investiga- 
tion is based were obtained as a part of 
the Guidance Study of the University of 
California Institute of Child Welfare 
(5). The Reputation Test was adminis- 
tered in the public schools of Berkeley, 
California, in order to secure material 
on the social adjustment of these 250 
Study cases, but since the test can be 
given only to an entire room, reputation 
data were secured also on the classmates 
of these children. Hence, the findings 
reported here are based on a much larger 
total population. The effect upon the 
sampling of selecting only classrooms 
containing Guidance Study cases is un- 
known; but the size of the group and the 
fact that the testing Was carried on in all 
the elementary schools of Berkeley, make 

seem likely that the population was 
quite typical of the entire elementary 
school population of that city during the 
years the data collection was 1n progress 
(1936-1939): Classrooms in all six grades 
were tested, but the group analyses re- 
ported here were performed only at the 
alternate grade levels I, III, and V. For 
Grade I, 119 children in four classrooms 
are included; for Grade III, 692 children 
in го classrooms; for Grade V, 628 chil- 


dren in 18 classrooms. Boys constituted 
Grade I sample, but in 


бо per cent of the 
boys and girls were 


Grades Ш and V, 
approximately equal in numbers. 


C. ADMINISTRATION AND SCORING 


For the first four grades, the children's 
opinions were obtained jn individual in- 
terviews. However, an experimental test- 


ing of a fifth-grade class indicated the 
feasibility of group administration at 
this level, and in Grades V and VI the 
test was given to an entire class at one 
time, and the children requested to write 
down their nominations in test booklets. 
The number of mentions given to and 
received from others, self-mentions, and 
mentions made by the teacher were tab- 
ulated by sex and grade and used in the 
various analyses. 

To obtain the reputation scores for 
each child, the number of mentions on 
each item (excluding self-mentions) was 
divided by the number of classmates who 
might have mentioned him. Scores on 
each dimension (composed of the posi- 
tive and negative items of each pair) 
were obtained by dividing the algebraic 
sum of positive and negative mentions 
by the number of classmates. 


D. Group DIFFERENCES 
IN REPUTATION 


So far as votes received are concerned, 
it was found that on the Majority of 
items girls enjoy much more favorabie 
status in the eyes of their classmates than 
do boys. The average girl was judged to 
be Опет, Poputar, FuLL or Fux, Nor 
QuanRELSOME, a Соор Sport, a LITTLE 
LaDy, Goop-Looxinc, NOT A Suow-Orr, 
Tipy, and Frienpty. The average boy 
was mentioned on the items WIGccLy, 
QUARRELSOME, Bossy, SHow-Orr, TAKES 
CHANCES, Nor BASHFUL, Соор AT 
GAMES, and REAL Boy. Although aggres- 
siveness was regarded as typical mascu- 
line behavior, the unfavorable connota- 
tions of such qualities as Bossy, SHow- 
Orr, QUARRELSOME, etc. suggest that 
boys are subject to much more disap- 
proval than are girls in learning their 
appropriate sex role. 

Age differences in reputation were less 
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marked than the ,sex differences cited 
above, but a tendency with increasing 
grade level for girls' scores to grow less 
favorable and for boys' scores to improve, 
operated to reduce the magnitude of the 
sex differences. The scores of both boys 
and girls were determined primarily by 
the opinions of judges of the same sex. 
Nevertheless, in the first grade, girls' 
scores were determined relatively more 
by boys than vice versa, while by the 
fifth grade, the situation was reversed and 
boys' scores were determined relatively 
more by girls. Since sex differences in 
reputation were so conspicuous even in 
the first grade, and since the picture for 
girls was so markedly favorable and for 
boys so markedly unfavorable, it seems 
likely that these findings reflect not only 
behavioral differences between boys and 
girls, but also the stereotype that litile 
boys are aggressive and dominant, little 
girls docile and well-behaved. 


à 
E. GROUP DIFFERENCES IN JUDGMENT 


Marked differences in the volume of 
voting on different items were found in 
teachers’ mentions and in children’s 
mentions of each other and of themselves. 
Both teachers and children made more 
nominations on favorable than on un- 
favorable items, and insofar as children's 
judgments of each other are concerned, 
this tendency grew more pronounced in 
higher grades. However, the trend for 
self-mentions was in the opposite direc- 
tion, self-judgments being made almost 
exclusively on favorable items in the 
first grade, but only slightly more fre- 
quently on favorable than on unfavor- 
able items in the fifth grade. 

Older children voted more heavily for 
others (and markedly more for thenr 
selves) than (iid younger children, but at 
all grade levels considerably more tha" 
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= gs 2 judgments, concerned persons 
ване, ше SEX Bs the judge. Certain 
cous, = apea WIGGLY, QUARREL- 
tomarily ме ei and SORE, Were IN. 
bot 9-29 tri buted to boys by judges of 
Nor pu S, Же others such as QUIET, 
ox a and Goop-LoOKING 
girls, eae. requently used to describe 
RO iten pean were made most often 
children ер with popularity for 
choosing ы t 18 ѕех concerned, the girls 
docility E connoting amiability and 
а at boys those connoting ath- 

ї skills and daring. 

habits ора respects, the judgment 
ба ктр» and of boys stand in con- 
dia а i voted more for others than 
boys a au three levels studied, but 
girls. ы self-evaluations than did 
saihe к) н. girls judged others of the 
bii ус а favorably Шап did boys, 
dpe whys + favorable self-evaluations. 
girly hab c ifferences between boys’ and 
between ка of judgment parallel those 
[6 p ан жоны older subjects, the 
are ee к, is offered that girls 
Tüdgsnengs mature" in the pattern of 

ѕ they make than are boys. 


F. Group DIFFERENCES IN 
AGREEMENT AMONG JUDGES 


là oj 
Order to measure the pervasiveness 


OE oss 
i diis among classmate judges, the 
Correlation. divided into two halves and 
Scores a computed between item-pair 
received [omm from one half, and scores 
"agreem rer the other half. These 
average ene coefficients increased on the 
te eee item-pair from .55 in Grade I 
СУ iege n and .81 in Grade V, 
Brou 5 considerable community of 
Р opinion. 
isagreement in classmates’ judgment? 
extremely infrequent concerning 


e 


Was 


children whose scores differ markedly 
from the average, but was very common 
in the scores of children who received 
few votes. On the average dimension 
about зо per cent of the children re- 
ceived a dimension score of zero, and of 
these about half were completely dis- 
agreed about (1.е., received equal num- 
bers of favorable and unfavorable votes). 
Of those receiving a definite characteri- 
zation on one item or the other of the 
average dimension, approximately 30 per 
cent in Grade I and 50 per cent in 
Grades III and V were identified with- 
out any dissenting mentions on the op- 
posite item. If those receiving only one 
dissenting vote are included in the group 
agreed about, the proportions are in- 
creased by about 15 per cent. In general, 
there was more concurrence in the scores 
of boys identified on negative items, and 
in the scores of girls identified on posi- . 
tive items. 


Agreement was quite poor between 


self-mentions and scores received from 
a pool of classmates, although the agree- 
nfént improved with the age of the sub- 
jects concerned. Agreement between 
classmates’ opinions and the teacher's 
judgment was somewhat better, but even 
here it was not until the fifth grade that 
the mean score of children mentioned 
by the teacher on the average item was 
significantly greater than the mean score 
of children not so mentioned. Hence, 
self-nominations, teacher mentions, and 
ate judgments cannot be consid- 
the information they 
yield concerning the individual child. 
However, all may be useful in evaluating 
the adequacy of his social adjustment 
and the social climate to which he must 


adjust. 


classm 
ered equivalent in 


Il. THE DIAGNOSIS OF SOCIAL ADJUSTMENT 


CHAPTER I 


THE DIAGNOSTIC USE OF 


N THE preceding paper, the data from 
I an extensive administration of the 
Reputation Test were analyzed for the 
purpose of revealing sex- and age-group 
differences in children's attitudes toward 
one another and toward themselves. A 
second major purpose of the investiga- 
tion was to explore the usefulness of the 
Reputation Test as an instrument for 
studying the social adjustments of par- 
ticular children. From this point of view, 
results of the group analyses may be re- 
garded as norms for clinical apppraisal. 
The successful application of group find- 
ings to the individual is a sine qua non 
for any device claiming clinical utility, 
despite the unavoidable loss in statistical 
precision when the focus is shifted from 
the central tendency to the single case. 
The present paper will therefore be de- 
voted to exploring the clinical potenti- 
alities of the Reputation Test as a de- 
vice for diagnosing individual children's 
social adjustment to their peers. 


A. THE CLINICAL SIGNIFICANCE OF A 
Синир? REPUTATION 


We have assumed that a child’s repu- 
tation with his peers is of central im- 
portance in assessing his social adjust- 
ment to those peers. Hence, classmates’ 
judgments constitute the most important 
basis for diagnostic interpretations of 
Reputation Test results, The evalua- 
tion of these judgments, however, can 
be made on different levels of refine- 
ment. 

At the most general level, one can 
simply inspect the over-all record to note 
the number of mentions received by the 
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child in question, and the ratio of favor- 
able to unfavorable nominations. ‘This 
method is quick and is probably ade- 
quate to locate both those who are so 
actively disliked, and those who are so 
utterly ignored as to constitute the most 
Serious problems of adjustment. In 
Grades I and II, the reliability of scores 
on individual traits is so low as to sug- 
gest that more refined methods are prob- 
ably unjustified. 

A somewhat more detailed approach 
involves using the profile of a child's 
Scores on specific dimensions of the Rep- 
utation Test to discover the particular 
favorable and unfavorable traits, which 
his classmates perceive in him. This type 
of analysis, by indicating specific areas 
of maladjustment, often helps give di- 
rection to remedial efforts. In the present 
study, score reliabilities were high 
enough in our judgment to justify such 
analysis for the third and higher grades. 
The primary limitation of this approach 
is the restriction imposed upon the mani- 


fest content of the test by the fact that . 


the judges are children. It is necessary 
not only to keep the test relatively short 
and the vocabulary simple but also to 
avoid items, despite their psychological 
importance, which might make the chil- 
dren anxious or defensive. The test used 
in the present investigation proved sat 
isfactory in these respects and. indicate 
the range and number of items which 
can be included. 

An interpretation much richer and 
more differentiating than that based a 
а score profile alone can be made PY 
utilizing in addition the many qualit^ 
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"ye: cues afforded by.a record as a basis 
for inferences which go beyond the mani- 
fest item content of the test—for ex- 
ample, taking into account discrepancies 
between the teacher's judgments and 
those of the class, differences in general 
reputation with boys and with girls, dis- 
agreement among judges on particular 
сл This inferential level of in- 
ea ation demands clinical judgment 
subject to error and bias on the 
Ce ne interpreter. However, the 
sible A. data available makes it pos- 
е с heck one s inferences for their 
wah re die: with independent aspects of 
ency lini. d as well as for their consist- 
e Фын h each other. The case interpre- 
He ne " be presented in the next chap- 
An illustrative of the potentialities 

C limitations of this approach. 
ee ч present investigation, the fea- 
па ы the child’s reputation record 
te cle t inspected routinely for diag- 

eads included the following: 
oe number of children who men- 
е, c iue subject one or more times in 
Ton "ped of the test. This afforded a 
E index of the child's conspicuous- 
"e E. the group—the popular, as well 
of the actively disliked, falling at one end 
Mas Scale, the isolated and withdrawn 
the. оер, Modifying factors included 
P M of boys and of girls who 
ы the subject and the attendance 
t ice. the child himself. Children's 
short ries for absent classmates are very 
of 2n inconspicuousness on the part 
ave «з who is frequently absent may 
в. T special significance. 

balanc 1e total. favorable-unfavorable 
child o, of nominations received by a 
ance n all items of the test. This bal- 
bis Plena a sort of reputational 
had ine for the child concerned, but 
to be considered in relation to the 


sex-grade norm, since girls ordinarily 
have much more favorable total repu- 
tations than boys. 

з. The child's reputation with class- 
mates on the various traits included in 
the test. Since not all variables were 
equally important in the children’s eyes, 
evaluation of a child’s score profile had 
to take account of the relationships be- 
tween particular items and the children’s 
conceptions of maturity, popularity, mas- 
culinity-femininity, etc. (See Studies in 
Reputation I, Chapter ПІ, and [12]) 
Another factor modifying the signifi- 
cance of a particular score was the 
amount of disagreement involved, both 
between boy judges and girl judges, and 
within either sex group. Marked dis- 
agreement was relatively rare but usually 
significant. 

4. The number of boys and of girls 
naming the subject on the Веѕт FRIEND 
item. Sociograms based on the voting on 
this item were constructed for each class- 
room, and used to evaluate the child’s 
position in the social organization of 
the group (13). These sociograms 
provided a check on inferences as to the 
child’s acceptance or rejection by his 
classmates, and frequently resolved ques- 
as to the meaning of disagreement 


items by relating such disagree- 
p of the 


tions 
on other 
ment to the clique membershi 
judges concerned. 

5. The record of the teacher’s nomina- 
tions of the child. The teacher’s men- 


o means perfectly corre- 


tions were by n 
and 


lated with those of the children, 
constituted an independent set of judg- 
ments made from an adult point of view. 
Differences in emphasis between teacher 
and classmates often made possible in- 
ferences about the child's maturity, do- 
cility, and orientation toward the teach- 


er's goals. 
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B. PROJECTIVE ASPECTS OF THE 
REPUTATION TEST 

The aspects of the Reputation Test 
discussed thus far concern judgments 
made about a given child by others—his 
classmates and teacher. Additional diag- 
nostic sources are the judgments made 
by the child himself. Utilization of this 
“projective” aspect of the record follows 
from the fact that a person’s perception 
of others depends not only upon their 
actual behavior, but also upon the psy- 
chological needs and defenses of the 
person himself. In evaluating a child's 
reputation with others, the fact that each 
judgment made about him involves the 
perceptual bias of the judge is not a 
serious limitation because a large num- 
ber of judges are pooled and idiosyn- 
cratic votes tend to cancel out. In evalu- 
ating the child's own voting record, 
"bad" self-nominations, i.e., those which 
contradict group opinion, can be a 
source of insights into the child's own 
areas of insecurity and his modes of de- 
fense. Theoretically, a child's "bad" 
judgments of others could be used ‘in 
the same way, but since in the present 
study corroborative clinical material was 
available for only a few children in each 
room, voting idiosyncracies were evalu- 
ated only on the quantitative level, i.e., 
by noting items omitted in judging 
others and items voted on much more 
heavily than usual. 

In order to differentiate between omis- 
sions which resulted from haste, distrac- 
поп, or turning two pages at once, and 
those which were indicative of an emo- 
tional reaction to certain items, a clin- 
ical appraisal of the total record was re- 
quired. If such omissions were related to 
the child's own reputation, we tended to 
regard them as psychologically signifi- 
cant. Most of the accidents of test ad- 


ministration opera:e to reduce the nunr 
ber of mentions made by a child. In 
instances where a child casts an excessive 
number of votes on a particular item, 
as for example, the little girl who named 
herself as a Томвоү and all the others 
as Litre Lapies, it seems reasonable to 
conclude that that item has special im- 
portance for the child concerned. Even 
in such instances, consideration of the 
relative instability of a single child's 
voting record suggests that projective 
interpretations of a voting pattern 
should be made cautiously and only in 
relation to other aspects of the record 
which can provide independent checks. 

The features of a child's voting which 
we attempted to relate to the personality 
picture afforded by classmates' judg- 
ments included the following: 

1. The number of classmates men- 
tioned by the subject one or more times 
on the test as a whole, as compared with 
the number mentioning him. This aspect 
of the record gave some hint as to the 
breadth of the child's acquantanceship- 
Especially important was the ratio of 
boys to girls mentioned. Children ordi- 
narily named more of their own sex. ^ 
tendency to mention more of the oppo 
site sex was quite rare and often indic 
ative, especially among boys, of exclu 
sion from the play group of the same sex 

з. General aspects of the voting rec 
ord—the total volume of voting, the dis- 
tribution of nominations between boys 
and girls, and the ratio of favorable tO 
unfavorable votes. These aspects of the 
record often supplied cues as to the 
child's general atttiude toward othe" 
children of the same and of the opposite 
sex. 

3. The distribution of a child's votes 
among the various items. The child's 
reputation with others on items whic? 
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ү жзнд or emphasized by heavy vot- 
g was noted for hints as to areas of 
defensiveness, etc. 
Cold child's voting on the Best 
pda Fry This item yielded leads as 
"P. 3 л s awareness of clique group- 
er ue 9 Е his own position with respect 
rarely Ё. iques. Secure clique leaders 
йс алш more than three or 
dicis we Among those who received 
бїлє diem BEST FRIEND, at least two pat- 
lenders a Ал naming several class 
isolation «ше responding to their own 
placed. i; y naung only one other child 
Dose er n a similar fringe position, or 
at all. 
Br ut suh ars mentions of himself 
епот items. The total number of 
Which a the particular items on 
ance of Ri бабай, and the total bal- 
fenster avor able to unfavorable self- 
they de Е were inspected for the light 
ception Tn throw upon the child's con- 
Sometimes limself. Areas of tension were 
ance of SS suggested by defensive avoid- 
items f E ou) unfavorable 
With e which the child's reputation 
younger eu was extreme, Qr, among 
the E І children, by self-nomination for 
I pposite trait. 
is AA the child's voting pattern 
in à Pp with his own reputation, 
ed а for clues that would permit 
be а to go beyond the mani- 
ias of the Reputation Test. It 
of the s emphasis that discrete elements 
fon E can gain meaning 17 rela- 
debug such elements. Successful 
full aa means the extraction of 
ticular valid meaning from the par- 
Served combination of elements ob- 
C. NORMS 
Nie remains the problem of the ap- 
iate choice of refererite norms for 


clinical appraisal. Since the means and 
standard deviations of the various scores 
and indices differ markedly for different 
sex and age groups, it is apparent that 
the significance of a given number of 
votes received or given on a particular 
item cannot be gauged accurately by its 
deviation from zero. 

Better alternatives are either norms for 
the grade and sex group based on several 
classes, or standards derived from the 
particular classroom in which the child 
happens to be. Obviously, the former 
are the more stable and accurate since 
they are based on many more subjects. 
In the present study, however, the vari- 
ous classes of a given grade level were 
located in different schools and are 
known to have differed as to the socio- 
economic background of the pupils and 
perhaps as to a variety of personal stand- 
ards and attitudes correlated with this 
difference. It is possible, moreover, that 
there were slight differences in adminis- 
trative procedure making for heavier 
voting in some rooms and lighter voting 
in others. Insofar as these factors enter 
into the results, the norms for a given 
room constitute a more adequate basis 
for describing individual deviations than 
do those based on a composite of findings 
from all the rooms of a given grade level. 
For these reasons an attempt has been 
made to relate the individual's record 
both to the grade norms and to his own 
classroom. 

On the individual record tables pre- 
sented in the next chapter, such of a 
child's mentions or scores as are most 
extreme among children of the same sex 
in his particular room have been printed 
in boldface type, those which are next to 
the most extreme in italics. Each record 
was also evaluated by comparison with 
the appropriate grade-ex norms derived 
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by pooling classrooms, but to save space, 
such norm values have been omitted 
from the record tables except as they are 
implied in the dimension standard 
scores. The significance of particular self- 
nominations and teacher nominations 


e 


may be judged by'reference to the pe 
centage frequency values in Studies in 
Reputation I, Tables 8 and 9, respect 
ively; the significance of votes given to 
classmates by relerence to the grade-sex 
means of Table 6. 


a 


—Y—— 


CHAPTER П 


ILLUSTRATIVE CASE RECORDS 


A. INTRODUCTION 


А TA PRESENT chapter is devoted to di- 


, agnosing the social adjustments of 
five children on the basis of their Repu- 
tation ‘Test records alone, and comparing 
the results with relevant case material 
from other sources. All subjects are mem- 
bers of the Guidance Study, and took the 
Reputation Test either in the third grade 
(Cases I and II) or in the fifth (Cases HI, 
IV, and V). They have been selected 
from among those available in order to 
illustrate different types of Reputation 
Test records and the clinical findings 
Which may be associated with each. Case 
1, Mary, is a third grader whose Reputa- 
tion Test interpretation of excellent 
Social adjustment is in agreement with 
the extensive case history material com- 
piled by the Guidance Study. In sharp 
contrast stands Alice, Case П, with poor 
adjustment indicated by the Reputation 
Test and confirmed by the case data. 
Case III, Margaret, has been included 
to show some of the limitations of our 
approach, for although the Reputation 
Test indicates correctly her poor adjust- 
ment, it is inadequate for specifying the 
Nature of her problems. Case IV, Fred, 
shows a pattern of moderately good ad- 
justment in a fifth-grade boy, which is 
confirmed by the case history. His test 
Profile correctly forecasts the nature of 
his later dislocation. Case V, James, is 
included because his record illustrates 

"First graders have been omitted because of 
the unreliability of their scores. Second, fourth, 
and sixth graders have been omitted because 
Many of the group analyses were not undertaken 
at these levels. However, the consistency of age 
trends makes it seem likely that porms for these 


Brades obtained by interpolation from adjacent 
levels would be accurate enough. for practical 


Clinica] appraisals. 
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the capacity of the Reputation Test to 
disclose difficulties in peer-relationships 
which may escape for a time the notice 
of adults. 

It should be made explicit that these 
case interpretations constitute illustra- 
tions of the diagnostic potentialities of 
the Reputation Test rather than a 
“validation” of it. Not only are the case 
records few, but they are more deviate 
and supply more clues for interpretation 
than would a similar series collected at 
random from among the entire group 
tested. Indeed it would not be possible 
to write a full or differentiating descrip- 
tion of children whose patterns lie near 
the group norm.? Further, it is not pos- 
sible to be sure that the case material 
included here gives an unbiased picture 
of the children in question, since the 
total volume of life history data accumu- 
lated from birth is very large, and only 
condensed excerpts from it could be 
included here. To minimize the degree 
of distortion from this source, the case 
summaries were written without refer- 
the Reputation Test interpreta- 
a routine selec- 
for each 


ence to 
tions and. prepared by 


tion from the same sources 


child. 

For each case, material will be pre- 
sented in the following order: 

1. The Reputation Test record. Owing 
to the expense of reproduction, the class- 
room sociogram and sex-age group norms 
have been omitted. Those of the child's 


t a serious limitation upon the 
css of the Reputation Test to the 
teacher or school counselor, since children 
whose social adjustment is poor do not ordinarily 
have average records, being either recognizably 
disliked, or isolated and unnoticed to a degree 


which is itself suspicious. 


2 This is no 
clinical usefuln 
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scores which are most deviate in his own 
classroom group are printed in bold- 
face, those which are second most devi- 
ate in italics. 

2. An “interpretation” of the record, 
le, a description of his probable per- 
sonality characteristics and defenses in 
the area of social adjustment, based both 
upon his reputation with others and 
upon his own voting. 

3. Clinical data extracted from the 
case material collected nearest the time 
When the Reputation Test was admin- 
istered. 

4. The writer’s comment upon the 
degree of agreement between the Repu- 
tation Test findings and the case ma- 
terial. 

Case numbers and names are fictitious, 
and facts which might be identifying 
have been disguised. 


B. Case I: Mary, A THIRD-GRADE GIRL 


1, Reputation Test Interpretation 


Mary is a member of a large third-grade class 
composed of approximately equal numbers of 
boys and girls and located in a school drawing 
from a rather prosperous middle-class neighbor- 
hood. She completely dominates the social or- 
ganization of the girls, eleven of them and even 
опе boy naming her as BesT FRIEND. Even more 
unusual is the fact that she in turn mentions as 
her friend not only a girl but also a boy (the 
most popular one), though nominations of boys 
by girls are extremely rare at this age. 

Mary is named by, and in turn names, many 
more other children on remaining items of the 
test than is usual for third-grade girls, but this 
result is hardly surprising in view of her central 
position in the group. " 

As might be anticipated considering her wide 
popularity, her reputation on other qualities is 
so extremely favorable that one suspects a marked 
halo in some of her scores. On all items save 
Quer and Nor Bossy, she receives from girls 
more favorable votes than any other girl in the 
class. The fact that she receives from boy judges 
more mentions than any other girl on 6 of the 
12 favorable items, and the second most on 2 
more, is quite as unusual, Some idea of the rela- 
tive infrequency of such a record as compared 
with the scores of al] the third-grade girls may 


be gained from her standard scores on g: ew 
item-pairs on which she is especially deviate: 
Besr FRIEND (5.00), Соор AT GAMES (4-40), Par- 
ULAR (3.90), FULL or Fun (3.40), and Соор SPORT 
$ AM on most dimensions there are one or 
two children who mention her for the unfavor- 
able quality in question, indicating that at least 
a few have not fallen under her spell. Some sug: 
gestion of the reason for this lack of unanimity 
is afforded first, by the fact that she reccives ш 
largest score from girls for Bossy (seven such 
votes, three dissenting votes); second, by the fact 
that boy and girl judges mention her more fre- 
quently than any other girl both on the GETS 
Map Easity and on the Dorsx'r Ger Map items, 
a very unusual degree of disagreement. e" 

Her teachers’ mentions of her as Porutar, No! 
BasurUL, and Litrte Lapy are not out of the 
ordinary. a 

The pattern of Mary's mentions of others Js 
lacking in significant detail, save that the ойу 
item-pair which she omits entirely is the Gere 
Mav-Doesn’r Ger Map dimension, on both poles 
of which she receives extreme scores from her 
classmates. This circumstance suggests that she 
may feel a little uncomfortable over this опе faw 
in her own near perfect social technique and pre- 
fer simply to skip the subject altogether. 

Mary's four self-mentions (PopuLar, Fury, OF 
FuN, Nor QuARRELsOME, and Соор AT GAMES) 
are all favorable, This result is not unusual 
among children of this age, and all four are items 
frequently so used by third-grade girls. How- 
ever, it is interesting that on the four on which 
she names herself she enjoys a markedly favor- 
able score, whereas, she fails to mention herscl 
at cither pole of dimensions on which her status 
is less assured. It seems possible that this child, 
whose social skill and awareness of others 15 
Obviously so marked, has made an honest state- 
ment of her assets, but prefers to appear „іп as 
good a light as possible and simply omits self- 
judgment with reference to traits on which her 
behavior is less exemplary, 

Summary based on reputation data. Mary €n* 
joys the approval of her classmates to a more 
marked degree than anyone else included ee 
this investigation. The resulting “halo” in judg: 
ments concerning her makes it dificult to char 
acterize her with reference to specific qualities 
However, she is apparently buoyant, a good po 
a little lady, and Tecognized as good at gU 
even by boys. On the other hand, her domina" 
position is apparently resented by some children 
and by them she is regarded as bossy and ра 
to get mad. She mentions her principal ass a 
quite accuratefy, but avoids mention of any ШЧ 
favorable trait. The fact that she omits the Ks. 
Map-Dorsv'r Ger Map dimension altoget! 


THE DIAGNOSIS OF SOCIAL ADJUSTMENT 4 
í y 


1 TABLE 1: 
REPUTATION Test Recorp or Case I, Mary 


Sex—Female 


Proportion 


Girls Present in Class —20. 
Proportion 


> 'Q о H ni 
Joys Present in Class —19. 


Age—S yrs., 4 mos. 
Mentioning Mary—95% 
Mentioning Mary—84% 


Grade—Low third 


(Norm 24740). 
(Norm ий; 


(Norm = 54%). 


Girls Enrolled i ; \ 
ы E = anen in e Proportion Mary Mentioned —65% 
“nrolle ass— i i e 
in Class—2r. Proportion Mary Mentioned —52% (Norm — 4070). 
— Votes Received Votes Given | 
—Гапз 
Negative-Positive From Girls | From Boys Stand- йй то To Girls | To Boys Пен 
—— | ar Mabey ш ЕГ. оен " 
Wioa Neg. | Pos. | Neg. | Pos. | Score Teacher| Self |Neg.| Pos. Neg.| Pos. Pole 
Nor 2 1 3 4 
M . B I 
пос: zd 7 3-9 + T I A 5 5 g 
0] От QUARRELSOME І 8 I $ 26 Bs 3 A $ EREE 
Bos :S-TAKES CHANCES | І 9 3.0 1 g Э 
OR Ѕрорт-С -1. 
Mob т-Соор SPORT Z ї Й H $3 кызк Ss 
Nor Ga BASHFUL 2 7 2 3 т.б + H Я * = 
s Map E, GAMES-GOOD AT GAMES 12 1 7 4-4 + 2| т исе 
Sis ERK PO N'T GET Мар 4 6 3 3 E M- 
IMBOY-LITT| oo m m £t m ia “> It AES 2 2| RB 
EST р TTLE LADY .6 
T FRIEND (no pair) х = ES т Be p . d se NN БЕ 
s е ы ——— ч 
otals 19 |ro8 | 12 | 47 E m ex) то | 21| 8|212 
3+ at 


t deviate ai 


even in ; 
M tis ОЙЛЕ others suggests, moreover, that 
Шке 1 c a little uncomfortable over her 
this dime measure up to her customary level on 
Successful chill However, she is an unusually 

У child, апа very well adjusted in the 


оша E 21 А ; 
in of social interrelationships. 


2. Excerpts From the Case History 


Mary is average in 
velopment. 
ford-Binet IQ = 


карна development. 
М weight, and general de 
148. one test results, Stan 
ne results have varied from 137 to 157) 
Or su er's comments: "Keen, alert, definite drive 
has m ccess, but not a show-off. Poised, modest, 
ity on sense of humor. A charming personal- 

с. T in harmony with its environment.” 
Bom. 7029 of teacher. (Data obtained five 
tiendi, before Reputation Test.) “Extremely 
and bo likes everyone. Popular both with girls 
еар Very stable and grown up, Bay and 
las] s Good-natured. Would. never pick a 
tween —acts as arbitrator for differences be- 
avera other children. More independent than 
Brou Be—plays with others but not dependent on 
iu Enjoys excelling but not upset by failure. 
Such excellent school work. I have never had 

a well-liked child before.” 

fine ОЕ an interview with Mary,at eight years. 
all th reference to social adjustment): I like 
on ы girls. The boys chase me,but I don't iell 
em. I don't like to quarrel—when I do, we're 


mong classmates of same sex; 


ve item of the pair; a minus, 


italic entries indicate child was 


a mention on the negative item. 


friendly again in about five minutes, so what's 


the use?" 
e. Comments of case worker. (Based on inter- 


views with child and with parent.) "Has four 
close friends and many more with whom she 
is less intimate. Is well liked by children and 
adülts. Knows she is well liked but does not 
seem quite secure in this direction. Would like 


to be better in everything. Has tendency to 
lly self-confident and well 


sensitivity. Unusua 

poised but decidedly restrained and self-com- 

posed. Very capable; sweet and passive manner 
s. Is neat and 


t at managing other 
t in appearance, 
] problems noted." 


but excellen: 
almost piquan 
looking. No rea 


but not good 


g. Comment 
e the Reputation Test re- 


od agreement with the data 
history. Moreover, 


In this cas 


sults are in go 
furnished by the case 
the Reputation Test indicates the pres- 


ence of some less desirable qualities in 
Mary's personality (Bossv and GETS 
Map), despite the fact that one might 
expect that child judges would be in- 
fluenced by a generally favorable set to 
report too bland a picture of her. That 
the unfavorable judgments passed on 


t 
48 READ D. 
her and the suggestion of inner tension 
may have a basis in fact is indicated by 
the case worker's comment that she "has 
à tendency to sensitivity," and again 
"knows she is well liked but does not 
"seem quite secure in this direction." Ob- 
viously this is a very unusual child and 
à correspondingly unusual record. The 
psychologically more significant problem 
of how she acquired such a personality 
is unfortunately beyond the realm of the 
Reputation Test. 


C. Case II: ALICE, А THIRD-GRADE GIRL 


1. Reputation Test Interpretation 


Alice is a member of a classroom containing 
14 girls and 18 boys. In this group she receives 
no mentions as a Best FRIEND, She herself names 
but one girl, who in turn votes only for the 
class "star." The total number of children men- 
tioned by Alice on the entire test is not unusual, 
although she mentions relatively more boys and 
fewer girls than the average third-grade girl. The 

her is near the norm, 


number of girls mentioning 


but she is mentioned by about twice as large a 
Proportion of boys as usual. 


TUDDENHAM 


Alice is mentioned snore often by boy judges 
than any other girl in the group on all but 
three of the unfavorable items included in the 
third-grade test, and on two of the remaining 
ones (QUARRELSOME and Bossy) she receives the 
second most deviate score of any girl. Girls in 
Alice’s class mention her most frequently оп 
three of the traits for which boys characterize 
her as extreme (Nor Many Friens, Serious, and 
Dorsy'r Take Cutances), and while the girls men- 
tion her on other negative items, her poor repu- 
tation is less extreme with them than with the 
boys. As compared with third-grade girls in gen- 
eral, Alice’s most extreme standard scores аге оп 
the negative poles of item-pairs, ejr, DOESN J 
ТАКЕ CHANCES (—4-90), Nor Соо» ar Ft 
(—3.80), SERIOUS (—2.76), Влзпкш. (—2.70), ane 
Poor Srokr (—2.46). Only on the item Livre 
Laby does Alice obtain a positive standard score 
(1.30), but 7 of the 8 votes she received were a 
by boys. In the third grade this item is correlatec 
more with “submissive” variables than wilh 
Poputar, and by the fifth grade conveys an pn 
plication of timidity and incompetence at games 
Hence, Alice's score on this so-called “positive 
item is at best indicative of her possession ofa 
rather. unvalued quality, and corroborates the 
evidence of her other scores that she is serious, 
timid, lacking in either motor or social skills, 
and in consequence isolated and unpopular in 
her group. T 

Alice receives 6 votes from her teacher, viže 


TABLE 2 


REPUTATION TEST RECORD or CASE II, 
Age—7 yrs., 10 mos, 


Proportion № 
Proportion M 


Sex— Female 
Girls Present in Class —14. 
Boys Present in Class —18. 


Girls Enrolled in Class—r4, 
Boys Enrolled in Class—18, 


lentioning Alice—38% 
Tentioning Alice—72% 


Proportion Alice Mentioned —46% 
Proportion Alice Mentioned 


ALICE 
Grade—Low third 


(Norm = 47%). i 
(Norm = 3492). 


(Norm = 54%). 


509 (Norm =4o%). 
| Votes Received | Votes Given m 
Item-Pairs om ж ЕЕЕ TED Н 
Negative-Positive rom Girls | From Boys SEED Rist To To Girls To Boys ore 
z = Neg. | Pos. | Neg. | Pos. Score |Teacher ү Self Neg.! Pos. Neg. Pos!  . 
IGGLY-QUIET = Г 
Not Many FRIENDS-POPULAR d 3 * = | р А Р г 
SERIOUS-FULL ОЕ Fux 3 5 7 ® 4 1| EF 
QUARRELSOME-NOT QUARRELSOME 1 - i | Qi- 
Doesn't TAKES CHANCES-TAKES CHANCES 8 | 6 | —4 3 -— 2 С 
Bossv-Nor Bossy 1 3 E E- I B- 
Poor Ѕрокт-Соор SPORT 2 || 4 {= + ® 5 
BasurUL-Nor BASHFUL zl 6 = x * | *| а Bac 
Nor Соор at GAMES-GOOD at GAMES g $ 9 | —3.8 xz | І G 
Gets Мар Easity-Dorsn't GET Map | 3 = + о : Mr 
Куна на Boy я zi z “A 2 RB 
OMBOY-LITTLE LADY oa i i i ЕН | L 
Best FRIEND (no pair) " А á "NE: * Pi `| BF 
т.т т | ee 
| > 
Totals 18 т 42 © | ж ыз [ж 17 3 6 
= | | Gy | 2 i] | 
Note— Boldface entries indi i i Pc "n й па wae 
лк ma aa dateien indicate child was most deviate among classmates of séme Sex; italic entries indicate child 
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egere FRIENDS, Dorsx'r ‘Take CHANCES, Nor 
and I 3 eii 6506 SPORT к т Сет Мар, 
р кыы In view of Alice's almost un- 
ibis nna захо reputation with her group, 
уши г to say that the teacher's negative 
ITE s about Alice agree with class opinion, 
Davey - of Ит positive ones (Соор SroRT and 
ment. It i d tan) аке Opposile 10 the class judg- 
en ilis 15 possible that the class mentions her 
e шл poles of these variables be- 
Кес, But E general unfavorable attitude toward 
ЧЫ а К they have better opportunities to 
their ЗН a ү than does the teacher, 
Alice's re час cannot be dismissed. In any event, 
one, and porn in this group is an unenv able 
could be as s nearly the antithesis of Mary's as 
d be imagined. 
ө pes mentions herself as a Соор SPORT and 
os X in. but concedes that she is Nor 
Alice ete AMES. In voting for other children, 
тене тоге favorable than unfavorable 
fewer ratte to boys and to girls, and somewhat 
ШЕЕ. T5 favorable mentions to cither sex than is 
expected, third-grade girls. This result is un- 
Who is so since one might anticipate that a child 
in turn кышын rejected by her group might 
compliment ct them and distribute numerous un- 
TI entary mentions. . 
15 ms pi items on which she casts an un- 
Vrarxps uod number of votes are Not MaxY 
girls, А кү: POPULAR for girls, Соор Sport for 
these 5 i Bap SPORT for boys, suggesting that 
Wailers IT may be important to her. One 
item eu T her voting for boys on the Bap Srort 
of ane anaidered together with the large number 
nee mentions she received from boys, 
deal С the possibility that they tease her a good 
than ey the boy judges are more hostile 
nomin ЕЕЕ Over the test as а whole 
iteing 3 ions on only four of the unfavora 
Shes "Г uses all except two of the favor 
A lien 2 hese facts taken together suggest that 
their al actively rejecting her classmates or 
amon alues, but lacks the ability to win friends 
5 them. 
ere based on reputation data. The total 
shut-in is that of a very much inhibited and 
ех „Ропа, though she may react ag- 
тү, Г Y if teased or intruded upon. The funda- 
the x: reasons for her generally low status in 
thats P are not obvious, and it seems unlikely 
a gud oor motor skills alone are enough to place 
there = such an undesirable position. Although 
terora р probably much negative halo in her 
Strong] on specific items, the reputation лїї 
рзусу 8691 the advisability of some i о 
ittle с} gical assistance. Probab, ; even this has 
ба hance to succeed while she remains in 
hos assroom where opinion has already crystal- 
against hers 


she makes 


. can always get a rise. 


2. Excerpts From the Case History 


a, Physical "UE. 2 i i i 
above av erage par capt Ч еа 
development. j аш 
E, ied test results. Stanford-Binet IQ = 

›б. (Has va 2 ined: 
pl eod copie e oki mid geom 
at ease. Too much. а ч "в. s ШОШ 
Bluffs, guesses when she isn't з pm 

3 Ses isn’t sure. Dislikes hard 
tasks and stalls." 

c. Comments of teacher. "Used to be very un- 
popular but now liked better and tries to be 
friendly. Disappointed if not accepted in group 
Never quarrels, Tense and excitable. Least eli. 
reliant in class. Likes praise. Behavior is on the 
whole better than average. Making remarkable 
progress in attitude toward work and work itself. 
Mother waits on her and won't let her go to or 
come from school alone.” т 

d. From ап interview with Alice. “Kids are 
mean to me—they tease and won't play. I invite 
them to my parties—then they ask me, but when 
I get there they just take my present and say 
oodbye'—don't even ask me in.” 

e. Comments of case worker (based on inter- 
views with child and parents). "Strong and un- 
wholesome emotional dependence on mother, 
which is perpetuated by the latter. Insecure rela- 
tionship with father who is moody and un- 
demonstrative. Poor social techniques and poor 
social adjustment. Not accepted by group and 
disliked by most children. Alice is careless of 
property and quarrels much with her mother 


aed playmates. Is teased by others because they 
Mother dresses her and 


temper tantrums in 
and screams, some- 
nd sullen if crossed. 
usts with difficulty. 


‘a 
Li 


undresses her to prevent 
which she smashes objects 
times for hours. Defiant а 
Irritable if plans upset—adj 
Refuses to mind. Aggressive, won't follow others, 


is angry if others don't follow her. Very timid. 


Whines and is fretful. Very mercenary—refuses to 
help in any way unless paid. Child badly spoiled.’ 


3. Comment 


In this case there is a rather marked 
discrepancy between the Reputation Test 
results and the case worker's report on 
the one hand, and the impression of the 
mental test examiner and teacher on the 
other. The subsequent history of this 
child indicates that the opinions of the 
children and of the case worker 
the more accurate. Apparently 
s record is a good example of the 


other 
were 
Alice 
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clarity with which even third-grade 
judges may diagnose a seriously mal- 
adjusted and disturbed child. 

The futility of transferring an unpop- 
ular child from one school to another as 
a therapeutic procedure, unless it is pos- 
sible at the same time to teach him 
better techniques, is illustrated by Alice's 
later career. At the end of the semester 
in which she was first tested, she moved 
to another district. After two months 
she was retested and had a reputation 
not far below average, but two years later 
was disliked by her new group even 
more cordially than by the old. How- 
ever, any program for the improvement 
of Alice’s personality would have to 
begin with altering that of her mother, 


and the prognosis for Alice’s happiness 
is not good. 


D. Case III: MARGARET, А FIFTH-GRADE 
GIRL 


1. Reputation Test Interpretation 


Margaret is a member of a large fifth-grade 
class in a middle-class school. Somewhat more 
than half of her classmates are boys. Girls іп 
this room tend to choose several friends each, 
and in consequence a rather elaborate clique 
exists in which about half the girls participate 
either directly or via mutual friends. In this set- 
ting, Margaret names but one best friend, a 
popular girl who does not choose Margaret in 
return. She is, to be sure, mentioned once on this 
item, but by an isolated girl who names twelve 
other “friends,” and it is clear that to all pur- 
poses Margaret is herself quite isolated from the 
others. However, she is far from inconspicuous, 
being mentioned by all the girls and by a larger 
proportion of boys than is usual at this grade 
level. In turn she mentions about the same num- 
ber of girls as does the average fifth grader, but 
somewhat fewer boys. Apparently she is less 
aware of the personalities of her classmates than 
they are of hers, 

The fact that Margaret receives the most nega- 
tive votes from the combined group of judges 
of both sexes signifies that her isolation from 
the group's friendship associations is no accident. 
Both boys and girls give her the largest score on 
SERIOUS (—3.00), thirteen girls and four boys 
identify her as Nor Goon-Looxing (—2.36), and 


eleven girls and four “boys mention her on Not 
Many FRIENDS (2.00). Girls also accord her an 
extreme position in the classroom on NOT A 
LEADER (—1.70) and Untipy (—1.16), and the 
second most extreme position on Nor Goop AT 
Games, Nor FRIENDLY, and FRIENDLY! The degree 
of disagreement implied on this latter pair of 
items (five "—" and four “4.” votes) is extremely 
rare. Were Margaret a member of a closely knit 
clique, one might suspect that these scores reflect 
some snobbishness in her behavior, and were she 
simply ignored on the item, one might conclude 
she is not outstanding on this dimension. Since 
neither is the case, one may speculate that Мак 
garet tries to be friendly but that her techniques 
are too poor or her behavior too inconsistent 10 
impress all her classmates in the same way 

Despite Margaret's unpopularity she r E 
an extreme score on the item Quirr, and severa! 
votes on other favorable items (including Мот 
Qarretsome, Lirrte Lapy, Nor Bossy, and з 
A $но\у-ОРЕ), which one would scarcely ps 
to find in a pattern otherwise so suggestive к 
maladjustment. Obviously her unpopularity i E 
not stem from over-a gressive or tomboyish 23 
havior. However, it is difficult to account for e 
extreme isolation on the only grounds imici 
by the test, namely, her being serious, not ме 
looking, and not a leader. This is a queer тебу 
in a sense, but apparently the investigator must 
look beyond the Reputation Test to reach more 
than the tentative hypothesis that Margaret 1$ 
best described as serious, passive, unspontancous 
and isolated for reasons not apparent from the 
test record, 

The teacher mentions Margaret as being QUIET 
and а Lirrte Lapy, but Serious and having NOT 
Many Frienps. In all four cases her opinion i$ 
in agreement with that of the class, but it fails 10 
throw light on why a quiet, unaggressive ише 
girl should be so unpopular with others. з 

Margaret's self-votes ате оп the items NOT 
QuARRELSOME, TAKES Снлхскѕ, Dorsw'r FIGHT 
BasurUL, and Томвоү; on none of these items 
is she outstanding in the opinion of the class, anc 
so far as Tompoy, Taxes CuaNcrs, and ВА$НЕОР 
are concerned, her class reputation is opposite 
to her own opinion. Her self-mentions do n9 
impress one as particularly protective, but дү 
are certainly unrealistic if credence be given 
the opinion of teacher and class. " 

In voting for others, Margaret distributes h 
Votes between boys and girls and between favor 
able and unfavorable items much as does pe 
average fifth-grade girl. However, she casts mor 
votes for girls on the PoruLan item than does ‚| 
other girl, and the second most votes for Ba 
on the negativé side of this dimension. wi 
one considers-her own rept tation for not hav? of 
many friends, it seems likely that her absence 


ives 


EX 


- 
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TABLE 3 
REPUTATION Test Record or САЅЕ III, MARGARET 


Sex—Female 
m. Present in Class —18. 
oys Present in Class —23. 


Girls Enrolled in Class—r9. 
Boys Enrolled in Class—24. 


Age—1ro yrs., 7 mos. 
Proportion Mentioning Margaret— 

. " H то 
Proportion Mentioning Margaret— vd 


Proportion Margaret Mentioned — 8 
Proportion Margaret Mentioned — ый 


Grade—High fifth 
(Norm — 8692). 
(Norm = 4090). 


(Norm =84%). 
Geen = 9:0 


Votes Received ivi 
Ne S. From Girls | From B Stand ae Item 
gative-Positi Fr irls | From Boys | Stand- i 
sitive — = y: en „Een те To Girls | To Boys Sync 
g. | Pos. | Neg. | Pos. | Score her| f |Neg.| Роз. Nez.] Pos: - 
P POPULAR тї 3 4 ® а A t ж |06 Q 
ARRE Ч Е "- 4 P 
Dou E NOT QUARRELSOME 9 4 s I г + 2 3 FF 
Е АКЕ CHANCES-TAKES CHANCES | 1 |- ж О Ses glo 
Boon Snot Bossy | Е 3 
оок Sroxt-Goop Sport m X Е ied Bo 
Nor ee Nor Basnrut т | а ks AE Б 
эте S DAMES GOOD AT Слика 6 ро 1 "d caa 
" ASILY-DOESN'T GET MAD 2 2 = 32 5 zd 
us | aj 2| І M- 
T йау Boy | RB 
: ITTLE LADY `; | зт 
EST Fg E 
OT Сашаны (no pair) A * la " T S ist a 
Stow. Ooo LOOKING-Goop-LOOKING 13 4 ü Е BS 
F-Nor A Suow-OFF z 18 | | SIN ue SL 
Nor ^ LEADER-LEADER | | | | vy 
FAtDYTipy 8 | ый | 2| i zig 
Чот P. Dorsw'T FIGHT x | | | о | + | а aig КА О: 
AN'T T. N DLY-FRI DLY 5 4 2 2 т 3 3 : Fr 
AKE A JOKE-TAKES JOKE ON SELF | 2 І = +4 т| т 1 Р 
Tota 
als 62 | a5 | 12 | 15 A 2 25} 27|38| 7 | 1 
= at} | 3+. 
Note— п б T 
oldface entries indicate child was most deviate among classmates of same sex; italic entries indicate child was 


ne: 
ХЕ to most deviate. 


] ^ 
hee a may be a source of real tension to 
another. the Serrous-FULt. OF Fun dimension, 
More hes which her own score is low, she casts 
her lass p than average but not the most in 
Self and a Эп Takes CnawcEs she mentions her- 
Опе else ras more votes for other girls than any- 
to the ct (азасы the significance of this item 
Bara: is obscure. Her votes on Nor Соор- 
mension and Goop-LookiNG, Ше remaining di- 
about i on which her own score is very low, are 
ec in number, and it is unlikely that 
С ры is much of ап issue to her. 1 
record mary based on reputation data. Margaret's 
цпро am VET peculiar in that she is extremely 
5 e ar in her group, but is not considered 
Usual Bgressive or to have domineering qualities 
girls, i associated with a poor reputation among 
e is n the contrary, she is a follower and quiet. 
i 199848 to be Srnrous, Nor Goop-LOOKING, 
Suggests and Nor Соор AT GAMES, Her record 
d cds further that she is passive, sober, and 
Ww tn Apparently she has poor social tech- 
arity 'ң ut may be tense over пећоуп unpopu- 
eg owever, she is. extremely conspicuous in 
group, and one can only coaclude that her 


е 
personality is atypical in some way not well de- 
fined by the Reputation Test results. 


2. Excerpts From the Case History 

a. Physical developme' 
large for her age and slightly abo 
sex maturity. 

b. Mental test resu 
= 151 (ten years). This h 
155. Examiner's comments: “Smiling and friendly 
—overaware of effect on people. Large and ac- 
tive, voice a bit unpleasant. Not bothered by fail- 
ure but constantly asked, ‘Is that right? A tiring 
child." 

c. Comments of teacher. “Daydreams all the 
time—always in the clouds; not friendly, diffident 
toward children and teacher. Not sociable, never 
chosen for games. Never leads and usually docsn't 
participate. Very quiet and somber. Not enthusi- 
astic nor stimulated by competition. Almost too 
docile and courteous. Seems to try to cover up 
hurts. Probably sensitive, but appears thick- 
skinned. A social misfit.” (In sixth grade was 
called by а different teacher “a nondescript child 


nt. Margaret is rather 
ve average in 


lis. (Stanford Form L) 1Q 
as varied from 139 to 


‹ 
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and very peculiar. Dreamy, 
and ‘blah.’ ") 

d. From an interview with Margaret. (Ob- 
tained one month before Reputation Test.) With 
reference to playmates: “Oh, I always play with 
the whole first grade, they're so cute. Boss in my 
room all call me ‘stink-bug.’ I like them all right, 
but they don't like me and keep away." (Note: 
One other child commented that although it 
wasn't really true, people felt about Margaret as 
if she "smelled funny.") “The girls already have 
other friends and don't want to make new ones. 
They never play with me." 

€. Comments of case worker, * xtremely poor 
social adjustment. Feels she's dis iked and ex- 
cluded from play. No playmates at school or in 
neighborhood. Lacks confidence and gets little 
satisfaction out of play with others, Child says 
she wants friends, but on the whole appears quite 
indifferent to people. Has practically no social 
relationships. Dreamy, unrealistic, and out of 
touch. 

“According to mother, ‘is very friendly, never 
depressed, always bubbling with enthusia n—a 
rosy optimist—can amuse self for hours—has vivid 
imagination. Her feelings are near the surface 
and easily seen.’ Mother detached and unreal- 
istic—for first time admitted that Margaret has a 
problem in social adjustment.” 


reserved, toneless, 


9. Comment 


Although Margaret. differs markedly 
from Alice (Case П), the Reputation Test 
gives clear evidence of the social mal- 
adjustment of both. From the case his- 
tories, however, it is clear in both cases 
that the sources of the trouble lie in the 
family, and that successful psychiatric 
help would necessarily have to deal with 
the persons in the home as well as with 
the child herself, Margaret's case demon- 
strates the limitations of the Reputation 
Test as a diagnostic tool. Although her 
poor adjustment js revealed by it, never- 
theless the inferences concerning her 
"queerness" must be based largely upon 
an elimination of more probable causes 
for rejection by other children 


; and can- 
not be very sure, 


E. Case IV: FRED, A FIFTH-GRADE Boy 


1. Reputation Test Interpretation 
Fred is a member of a fi 


І fth-grade class of 
thirty-five, of whom fourteen a 


re boys, Voting on 


the Brsr Frienp item is heavy in this room and 
most bows are members of a complex clique. 
However, Fred is not included in this . The 
only boy for whom he votes is a class leader i 
ceiving six votes, but three boys in a з 
“fringe” position vote for Fred. So far as Гопи? 
ships are concerned, Fred's status is below aver 
age for this class. 
On other items of the test he is mentioned by 
a very large proportion of his classmates, and 10 
turn names more of them than the average 
fifth-grade bos. On most individual items, Tus 
reputation score is favorable, More girls mentior 
him than any other boy on the items Que 
PoruLar, Nor Quarketsomr, Соор Sport, NO 
А Suow-orr, and Dorsx'r Ficirr, and from them 
his score is second most extreme on the addi- 
tional items Соор ar Games, Dorsn't С м 
REAL Boy, Tipy, and CAN TARE А Joke. Бр 
mention him most frequently on the items Quin A 
Тірү, апа Dorsx'r Figur, and second most ne 
quently on Nor QUARRELSOME, Not Bae T 
Dorsv'r Ger Мар, and Furrxpry, However, d 
rclational analysis (12) suggests that these шше 
are in general more valued by girls than by m ia 
and it is possible that his high status on ther 
items may be related to his failure to be include? 
in the clique dominated by "regular fellows. 
Tentative confirmation of this hypothesis 15 vee 
fered by several facts, First, he receives more 
mentions on Dorsx'r Tak than’ any 
other boy. Second, he receives four votes on the 
negative and only two on the positive side of the 
Соор ar GAMES dimension, although girls е? 
sider him competent, (Does he play with gi!” 
where there is less competition?) ‘Third, hc 2: 
ceives as many votes from boys on Sissy as та 
REAL Boy, although characterizations on s. 
latter item. are more common, This pattern 0" 
reputation scores suggests that Fred is пады. 
sive and friendly, but is held in higher regard E 
girls than by boys, and is mentioned for quali 
Which are more appropriate in girls than in Ж 
especially Quirr (3.00), Nor QuannELSOME (ag 
Dorsw'r Figur (2.00), and Dorsn'r 'ТАКЁ 
CHANCES (— 1,09), lot 
Fred's teacher names him on Nor Bossy, Par 
^ Sirtow-Orr, Dorsx'r Ficirr, апа FRIENDLY, o 
mentions that he Dorss'r ‘Take Сплхскѕ and Ё 
a Poor Sport, ng 
Fred's record of self-mentions is unique amor 
all the children to whom the test was END le 
that he names himself on 15 of the 18 favora a 
items. His only negative self-nomination ру 
Doesn't TAKE CHANCEs, but equally unusual JIf- 
comparison with the average boy are his A ds 
mentions on Quiet and. Goop-Lookixc. T P 
pairs omitted By Fred are Nor Basurut-Bast! һе 
апа LEADER-Nor A LEADER, on both of ун 557 
receives а smaj; negative score from his en 
Mates. Since Fred’s reputation with others 15 


^ 
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„ TABLE 4 
: REPUTATION Test RECORD ОЕ Case IV, FRED 
ex—Male 
ERE Гаје Age—10 yrs., 2 mos. Grade—Low fifth 
jirls Present in Class —21. P ion V ioni | 
pee peed 21. roportion Mentioning Fred— 86% (№ = 
ys sent in Class —13. Proportion Mentioni Жоха 
E Mentioning Fred—100% Norm = А 
Girls Enrolled in Class—21. Proportion Fred Mentioned очы 
CHEE i азв—21. i Mentioned — 62 N = 
| ys Enrolled in Class—14. Proportion Fred Mentioned — | animes 
= = =79/0 
e ка Votes Received Votes Given 
„ ltem-Pairs 
аР е [From Boys | Stand- | prom | To | То Girts | To Boys Sm. 
Ex tides УЕ rom o 4 ym- 
= aa . | Neg. | Pos. Score Teacher | bole 
iGLY-Qu! | | | 
Мот A Su M | 10 | s o 
FRIENDS-POPULAR | 3 | | 5 НЕ F ЕЕЕ 
TAK Хот QUARRELSOME | E ^ д 2 | i iP 4 : m 
к АКЕ CHANCES-TAKES CHANCES 1 3 | -r.o Ex З iE: :118- 
Pooh S MOT Bossy I ; a j» 
ASHE ORT-G00D SPORT | & | t E к EE E а= 
rae CUL-NOT BASHFUL 1 a Е + : 5| Š 
JETS Map AT GA! оор AT GAMES | 2 4 2 |= 53 t Ж DCE 
5 AD ЕЁлзп.у-Рокзх'т GET Мар €] 4 US + ара М 
ISSY-Re 1 ; ав 
2 9 3 | 3 E T 2 
Bre] LITTLE LADY : ЗЕЕ" 
vor QRIEND (no pair) Е Е E MM BE 
Suow-Orp NOU d o0D-LOOKING 3 |: го | t "| G 
N FF-NoT A Suow-OFF i | 4 1 + + MEET Ex 
OT А LEAbER-LEADE | | Е 
BNTIDY-T1p R-LEADER | BEP] ipt | (ee) ЕЕ 
"os Men ИНЕ FEINER: 
is Dorss't ант 4 7 | 20 + 1 1| F- 
Anes N RIENDLY a E 
T TAKE A JokE-TAKES JOKE ON SELF 2 d | ii | * $ | й i г | 2 i 
tala [a [ss | | 62 | aee m rz то | 21 | 32 | зо 
3 | | | | 4T] 15+ 
of same sex; italic entries indicate child was 


Not s S Р м: 

e— ? pape» " i 

ext to Boldface entries indicate child was most deviate a 
most deviate. 


ne 
the 
tr ir it is likely that this very 
ative "oe agree of self-approbation is more indic- 
tendenci seomyplacency than of compensatory 
Reversed I One wonders if Fred would not have 
TAKE Gn м» төн negative self-vote on DOESN'T 
tistical WANG had he realized that by the sta- 
Tccion conventions of the tabulation it would 
Fu Е a minus score. 
and cb E more votes for others than average. 
of boys ois relatively more mentions of girls than 
Again ы compared with the norm, suggesting 
in them ie he has more contact with, or interest 
of the С He mentions more girls on both poles 
than num AT Games and FRIENDLY dimensions 
than 297 Ое boy. He casts more votes for boys 
Many. S e his ‘classmates on the items Nor 
Looking RIENDS, „Мот BASHFUL, and Nor Goop- 
loop. a but his only nominations for boys on 
Suggest; 'ORING and Tipy arc for himself. This 
usual 3 that he is smug about himself but un- 
on wie critical of other boys. However, the traits 
Warden d he considers himself superior ue re 
girls. y most boys as more appropriate to 
ну based оп reputatio, 
too indicates that he is а "800€ 
good to be quite cred?ble. He rece 


data. Fred’s 
boy,"—almost 
ives many 


mong classmates 


favórable nominations from children of both 
sexes, but they tend to be on items which are 
more important for the adjustment of girls than 
of boys, and in actual friendship associations 
Fred is rather excluded from the group. He is 
friendly and unaggressive, but apparently quite 
complacent and conceited. He is probably cau- 
tious, not very good at games, and not quite a 
"real boy," his own opinion to the contrary. He 
scems to have relatively more contact with girls 
than do most fifth-grade boys, and is better liked 
by girls than boys. Fred's apparent personality 
pattern comes close to the children's conception 
of an ideal girl, but one has some fears for his 
social adjustment as he enters adolescence where 
more masculine behavior is demanded of him. 


ә. Excerpts From the Case History 


a. Physical development. Fred is above the 
norm in size, but slower to mature than average. 
b. Mental test results. (Stanford Form M) IQ 
= 149. (Has varied from 125 to 156.) Examiner's 
“Well poised and friendly. Makes ef- 


comments: 
fort to do well—very earnest and tries hard to 
please.” 

c. Comments of teacher. (Data obtained six 
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months after Reputation Test but from same 
teacher.) “Extremely popular, pliable, courteous 
child. Lovable and likes others. Excellent be- 
havior and attitude toward school. Good sense 
of humor—never shows off. Above average aca- 
demic performance. Is product of a wonderful 
home environment." 
d. From an interview with Fred, “All the boys 
I know like me—I have lots of friends. Dick is 
my best friend. He's swell and I'm good, too. 
He and I are about the best in school." 
€. Case workers comments. "Likes teacher, 
likes school. Is always cooperative in interview, 
but cautious until assured of a sympathetic audi- 
ence. Is rather quiet—not a show-off. Always 
good-humored and cven-tempered, Dislikes get- 
ting into arguments, Extremely sympathetic and 
generous. Perhaps a little dependent on mother, 
who is determined not to have Fred a ‘sissy’ but 
scolds him if he comes home after play with his 
clothes torn or dirty. Seems to put forth a great 
effort to do the correct ог approved thing in all 
situations. Is self-satisfied and takes himself seri- 
‘ously in his attempt to live up to his ideal of 
perfection, Is wholly unaware of his own liabili- 
ties, and receives enough success at school and at 
home to convince him that he is succeeding in 
reaching his goal.” (T'wo years later the comment 
was made: "Role of being the perfect boy seems 
to have become so habitual that it no longer 
requires much strain," 


3. Comment 


Fred reveals himself on the Reputation 
Test to a surprising degree, and the in- 
terpretation coincides with other data 
concerning him. His favorable reputa- 
tion on many items viewed in relation to 
his exclusion from the clique organiza- 
tion among his Classmates is more evi- 
dence of the truism that exemplary char- 
acters are more apt to be respected than 
Sought out as friends, Noteworthy is the 
fact that at adolescence Fred lost status 
and was almost isolated by the other 
boys, whose group values at this stage 
were for active, aggressive, nonconform- 
ist qualities which Fred lacked. Despite 
the over-all favorable impression of his 
teacher, the Reputation Test correctly 
forecast the nature of these adjustive 


difficulties in Which Fred later found 
himself. 


м ` " Y 
F. Case V: JAMES A FIFTH-GRADE Bo 
1, Reputation Test Interpretation 


James is a member of a fifth-grade -—— 
taining almost twice as many girls as e. Sendi 
than half of the children enjoy reciprocal ee i 
ships with other members of the class. Alt larity, 
there are four “stars” of exceptional popu d if 
no complex clique groupings can be a boy 
this group James chooses as Best r - EE 
who in turn chooses him, but neither rec M 
any votes from anyone else. James's bee 
a Brsr FRIEND of a girl (who, however, f Wm 
mention him) is sufficiently uncommon to с 
mention, On the test as a whole, James | эп 
tioned by fewer boys and by fewer girls Гк год: 
the average fifth-grade boy, but he mentior 
siderably more than the average. туа ЕШ] 

The votes James receives оп negative rwic 
both from boys and from girls, are almost How 
as numerous as are his favorable mentions. ; the 
ever, since he is relatively inconspicuous, БЕ, 
total number of unfavorable judgments E 
large, and on no item-pair is the boy's štand? 


score larger than —.8g. His more devia 80), 
are reccived on the items Nor a LEADER Ке 
Sissy (—.8g, although three girls RUM, 
а Келі, Boy), Best FRIEND (—.70), DOESN'T E) 
CuANCES (—.бо), Nor Соор ar Games (—:5 
and SERIOUS (—.5о). um LEAL 
None of these items is correlated with '/ Sead 
Boy and its associated variables, The implica 
tion is plain that James is, if not somewhat i, 
feminate, at least not as masculine as the dl 
This impression is substantiated by the fact it xdi 
the items on which he received a favorable t 
ard score (Quier, Nor QUARRELSOME, Nor В. оте 
FUL, Tipy, and Dorsw'r Ficnr) are traits M 
valued by girls than by boys. EET 
Jame's teacher mentions him as POPULAR, £ ГҮ, 
OF FUN, A Соор SPORT, A REAL Boy, ERE 
and most significant, as her Best FRIEND, an ee 
usually omitted by teachers. This wholly nen 
ble picture is quite at variance with that oe 
by his classmates, It Suggests that James P 
along better with adults than with children, ^ 
probably presents a pretty bland front to 7: 
former. In this case it may be that the w 
suffering mild hostility from his classmates E is 
result of being too well liked by his teacher ved 
further Possible that the approval he rect аса“ 
from his teacher indicates that he is brighter 2 
demically than most of his group. ean from 
Despite his favorable and secure position nce 
the point of view of his teacher, some pes 
of insecurity is offered by the fact that he P 
himself only on unfavorable qualities, and m^ 
the next to tife most such mentions of any 
in dass (The average hoy is more D 
name himself Yor favorable qualities.) Som 


iate scores | 
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* 4 TABLE 5 
х REPUTATION TEst RECORD OF CASE V, JAMES 
Sex—Male A 
Age тт yrs., I mo. 1 
| gis Present in Class —25 Рудого Mentioning J pen se 
oys Present in Class —1 ; i ioni ames— sa% iNoumus 6470) 
| 3 ass 4. Proportion Me -— 4202. 
| pane ten HE р ntioning James— 69% (Norm=70%). 
rls Enrolled in Class—25. Proportion J Menti 
Boys Enrolled i 25. porti ames Mentioned — 72% (Norm= 
7 ed in Class—14. Proportion Menti A 4970)- 
кайы RE 4 р James Mentioned —100% (Norm = 79%). 
; : Votes Received Votes Given 
. ltem-Pairs ; 
NA AIR ve From Girls | From Boys | Stand-| prom | то [Тоби | To Boys dE 
I———— ar DN (eh mu 
= Neg. | Роз. | Neg. | Pos. | Score Teacher| Self |Neg.| ( bols 
Nissty-Ourer 3 | с 
bs MANY EN! р D k 
DUE nr «| AES iii 
JARRELSOME I 3 E H Р 2 =) КЕ, 
TAKES CHANCES 2 = .6 - Sa Ps Е КЫ ae 
2 1 
F ч 1 к К; 
BAS PORT-GOOD SPORT y 4 4 I inge 
Nowe Nor BASHFUL | Я EG ^ - DV EU 5 
Сите Moo АТ GAMES-GOOD AT GAMES 1 3 = 35 — Кы, р. er 
AD Easity-Dogsn't GET MAD 2 2 о.о = Ij 4 3 &- 
4 $ 3 haa + m 1| 6| RB 
(no pair) 5 ч a 7r - + б HE: 
oKING-GoOD-LOOKING 2 p^ 4 1 à 1 GL 
Or A Suow-OrF 3 ї т = 3 5 т Sh- 
E asian 4 A =: В m L 
Jor F oESN'T FIGHT л 7 т Р 
Gan ELE NDLY-FRIENDLY = af T Fr 
AKE A JOKE-TAKES JOKE ON SELF 1 tja 1| 3 J 
Totals тї 6 |18 | 1 A в) 3i) 17 | 32 | 19 | 19 
6+. ot 


Note— a 
next us Boldface entries indicate child w: 
© most deviate. 


a sclf-mentions, viz. Dorsv'r TAKE CHANCES, 
his 3 Soop AT GAMES, and Nor A LEADER, indicate 
Яс MATCH of being less -venturesome and 
КС than other boys. His other self-votes 
i Map and Ficnrs) are not in harmony with 
opinion of the class, and may indicate ag- 
Stessive wishes or a fantasy of being more ag- 
кеше than he really is. In any event, he seems 
red and better able to verbalize his problem 
an most boys in similar circumstances. 
ieee is relatively more interested in or at 
ast more aware of the personalities of girls 
than of boys. He casts more votes for girls than 
any other boy on seven items, and the next to 
a most on four more, although on no item is 
S correspondingly extreme for mentions made 
t boys. Not only does he cast more votes for 
Cus than for boys, but relatively more of them 
b € favorable. He casts the most votes of any 
Oy for girls both on Bossy and on Nor Bossy, 
de makes a similarly extreme number of men- 
ns of girls on the Соор AT Games-Not Соор 
AT Games pair. On the other hand, in mention- 
ng boys, he names onl- one as Boss" and one as 
Or Bossy, omits Соор AT Games (usually an 


as most deviate among classmates of sam 


е sex; italic entries indicate child was 


oting than any other in 


e 
item eliciting heavier v 
y one boy as Nor Goop 


the test), and names onl 
Ar GaMrs. These facts taken together suggest 
quite strongly that he does not play much with 
boys but rather enters, or at least tries to enter, 
into the girls’ games where he is sometimes re- 
buffed by the "bossier ones." However, the fact 
that he makes six nominations on the ReaL Boy 
item indicates that this is an important dimen- 
sion for him and possibly one concerning which 
he feels sufficiently uneasy to omit a self-mention 


on either pole. 


Summary based on reputation data. James is 


probably a bright, polite boy, more attractive 
to adults than to other children, though not 
actually unpopular with anyone. He is not very 
masculine, is a follower, cautious, unaggressive, 
and lacking in athletic skills. He is probably open 
and outgoing but quite insecure, and may harbor 
aggressive wishes which he is unable to carry 
into action. He seems to know more about girls 
than boys, and to esteeni them more highly. How- 
ever, he is not too well thought of by members 
of either sex. Fortunately, he has one close 
friend in the class who may give him considera- 


© 


ble support. He may be leaded for an unhappy 
time in adolescence. Efforts to improve his physi- 
cal skills might well be expended on his behalf. 


2. Excerpts From the Case History 


а. Physical development. James is slightly 
above average in height, but very obese (girdle 
adiposity). Sex maturation definitely below aver- 
age. Has had a kidney disorder of long standing, 
and in consequence his physical activity has been 
curtailed on medical advice. 

b. Mental test. results, (Stanford, Form L) 1Q 
= 149. (This has varied from 197 to 149.) Com- 
ment of Examiner: “Interested in success but 
not upset by failure Friendly, relaxed, and 
gracious, Cooperative and kindly. Good insighi— 
a few show-off manncrisms, but нне well 

ШЕШ 
m Teachers comments, “Very friendly and 
well liked, witty and humorous—sell- reliant, 
quite courteous. A leader admired hy others, has 
ШИШЕ ACCC, PHONG (lle. ond ds 
Grades good er exeellent- Heet join in hard 
games because of physical condition. Quite a 
Hhinker and roulé cán conces ий аш lever 
А well-adjusted child." 

d. From an interview with James. With refer- 
ence 10 social Adjustinent: "E used te be shy but 
| have lots of friends now, I always arrange to 
meet Robert (named as friend on the Reputation 
Test) at recess." (О) "We don't play much—just 
walk around." 

With reference to teasing: "Sometimes kids 
say, 'Hi-ya, fatty?’ but I don't let it get underamy 
skin unless they do it too much.” 

With reference to scholastic work: “I always 
get a good card but not better than most." (Note: 
One year later James commented that he knew 
lots of people but didn't have bosom friends. He 
admitted that he was not popular, but he 
thought boys like him better than girls.) 

€. Case worker's comments, "Is overdependent 
upon mother. Demands attention and is lazy. 
Very sensitive to remarks about his size. ‘Too 
cautious, never wants to try anything new. Is 
friendly, expressive, and spontaneous, Dislikes 
quarrels and keeps out of them. Good-natured— 
gets along well with adults and children, Prefers 
to win, but isn’t too disturbed by failure. High 
energy level, a verbal child with an adult vocabu- 


lary. Seems to be quite content with his lot in 
life.” 


3. Comment 


James's major problem, apart from his 
physical handicap, seems to lie in the 
field of social adjustment to his con- 
temporaries. It seems obvious th 


: at his 
difficulties are rel 


ated to his inability to 
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participate in active sports, but a solm 
tion to them is difficult. It is interesting 
that the Reputation Test revealed 
James's rather poor status at a ume 
when adults were giving this polite and 
verbal child a much more favorable 
characterization, and a year before the 
boy himself admitted the true state of 
affairs. 
G. CONCLUSION 

Mlustrative clinical interpretations 
have been presented based on the Rept 
‘Test nye Guidance 


( пири 
Study subjects chosen to represent sont 


tation records of 
al ihe mare deviate patterns alitnined: 
Teachers’ mentione self-mentinnes, rept- 
tation ailih ана votes piven lo other 
Classmates were considered in relatio 
to the нынн fut ihe apprapriate sex atil 
grade level, and to the pattern of friend 
ships revealed by the Bese Fires. iten. 

‘The adequacy of a clinical characte!” 
ization of a child based on his rep uta 
tion record depends, apart from the in- 
sightfulness of the interpreter, upon how 
deviate the child is in his group and 
upon how full his record is. However: 
an extremely scant number of vote? 
given and received may itself be indic 
ative of a withdrawn personality. Be 
havior which is not correlated with that 
elicited in the school situation cannot be 
predicted on the basis of the Reputation 
Test, and nonsocial aspects of perso" 
ality are also difficult to get at. Stale 
ments about more obvious personality 
characteristics can be made quite acc" 
rately, within the limitations note‘ 
above, on the basis of the reputation dat? 
taken alone. Inferences about a child? 
areas of tension derive from his тери 
tion, and in addition from his pattern e 
voting (i-e, from the projective ape 
of the test), but the significance of t Я 
latter сап bé evaluated only in relati? 
to the former. 


THE DIAGNOSIS OF 


We conclude that although the Repu- 
tation Test is limited both as to the areas 
of personality which it can reveal and 
as to the types of questions which it is 
expedient to include in a classroom set- 
ting, it is nevertheless useful in diagnos- 
ing a child's adjustment to his class 
mates, and can throw some light on his 
Social maturity and on his areas of sensi- 
tivity and conflict. Since the Reputation 
Test yields that is not 
always directly accessible to teachers 


information 
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making judgments from an adult point 
of view, it frequently reveals problems 
making for social maladjustment much 
earlier than they are ordinarily detected 
by adult observers. Hence, it may make 
a practical contribution to counselors 
and school administrators, both in lo- 
cating children who are having psycho- 
logical difficulties in the field wi social 
relationships, and in measuring the ef- 
fectiveness of efforts on their behalf. 
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I. INTRODUCTION! 


eS rem 
di розбою Б І сестры grew out 
E haa: orschach research in the 
Welfare iie at the Institute of Child 
Mice а im Сир лае 
Dead” aen : (1) ап Rorschach ex- 
md io е оп ratings of adjustment 
ре» the аан (г) In what way 
сена hen amounts of Rorschach ma- 
he ect saeh judgments? (3) If sub- 
Gone e agreement can be 
le a what relationship can be 

ў vith outside criteria? 
of pis article from the Institute 
ee elfare (5), the possibilities and 
‘tinal 2 inherent in the "sign ар- 
Mise o the Rorschachs of a normal 
огей | population have been. ex- 
cating d | ле article presented data indi- 
ee des the incidence of the so-called 
so dizh = signs in this population was 
Sn пи make meaningless the label 
adoles uc. The possible hypothesis that 
"escence is a time of emotional tur- 
P and that one could, therefore, ex- 
many neurotic signs, was not sup- 
iui by the data. With this hypothesis 
Бе мм predict а decrease in the num- 
signs as the crisis period in ado- 


atistical analyses were 


1 š 
Clerical work and st 
m the U. S. 


ee Y m bya grant-in-aid fro 
йай, Раин Service. The study proper was 
tan — by assistance from the Laura Spel- 
the Ri und, the General Education Board, and 

s ockefeller Foundation. 
CO din acknowledgement is due to Jean W. 
titur папе, Director of the Guidance Study, In- 
E of Child Welfare, for her help and sug- 
jo dons throughout this study; to Lucile Allen 
gro AE special adjustment ratings of the С 
the р; to Helen Clementson for acting a5 one of 
ог pages; to Edith Katten and Arline Burton 
3 heir roles as control raters; and to Frances 
‚ Orr and Margaret Snyder for their work in 


айтп ч 
Wi ee the Rorschachs. The authors also 
sh to thank Dr. Rheem Jarrett and Charles 
1 Brittomar 


Ta 5 я 
шу for their statistical advice, ало 
апа Поп for assistance in computation. 


lescence began to merge into adulthood. 
In our group, no consistent decline was 
evident over the age range 11 to 18 уеаїѕ. 
Conversely, the indicators of normality 
(Rorschach "adjustment" signs) were 
low; their correlations with interview 
ratings of adjustment varied nonsignifi- 
cantly around zero. x 
The results of that study made it ap- 
parent that the "sign" method offered 
little in a systematic and fruitful ap- 
proach to the understanding of the 
Rorschachs of our cross section of ado- 
lescents. These findings may not be sur- 
prising to many Rorschach workers. One 
of the major characteristics claimed for 
the test has been that, for a meaningful 
understanding of the dynamics of per- 
sonality organization, the Rorschach 
must be used as a gestalt. Clinicians 
hat the more atomistic the Ror- 


agree tl 
schach analysis, the less its worth as an 
evaluative instrument. With this in 


for the present study, three ex- 


mind, 
re asked 


perienced Rorschach workers we 
to make subjective judgments of adjust- 
níbnt on the basis of the Rorschach 


records. 
IL. THE SAMPLE AND CRITERION 


The subjects were 71 boys and 75 girls 
a longitudinal 


who were members of 
growth study and had been randomly 
selected 18 years previously from the 
birth registry in Berkeley, California.’ 
The Rorschach had been administered 
as part of the testing program of the 
study, beginning when the children were 
11 years of аре. As a result, the 18-year 
records used in this experiment are the 


fourth Rorschach for most of the sub- 


jects. These records were chosen for three 


2 For a complete description of the sample, see 
Macfarlane (8). For a discussion of Rorschach 
procedures in the Guidance Study at the Insti- 


tute, see McFate and Orr (3). 


‹ 


To 
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reasons. First, they are the most "adult" 
records and, therefore, more comparable 
to other "adult" norms in the literature. 
Second, age 18 has the largest number of 
cases at any one age in this sample, and, 
third, these records are longer and richer 
than earlier tests and thus offer a better 
basis for rating. 

The outside criteria of adjustment con- 
sist of ratings of current adjustment 
made by case workers and based on con- 
siderable interview contact with the sub- 
ject over a period of years. The areas of 
self-adjustment, social adjustment, and 
family adjustment were among the vari- 
ables rated. These ratings and the inter- 
views upon which they were based will 
be described in detail in the section on 
validity. 

III. PROCEDURE 
A. JUDGES 


The ratings of the Rorschach protocols 
were made by three women judges. Since 
ratings depend upon the training and 
Rorschach experience of raters and the 
breadth of the sample upon which the 
experience is based, a brief statement 
about each rater follows. 


Judge A was trained by Bruno Klopfer in 
1939 and has subsequently attended several 
"workshops." In the course of ten years of ad- 
ministering and teaching the Rorschach, she has 
seen and evaluated well over 5,000 records, in- 
cluding all ages and both normal and pathologi- 
cal cases. 

Judge B was initially trained by Judge A in 
1943 and has- subsequently had several "work- 
shops" with Bruno Klopfer. She has worked 
with other Psychologists, well trained in the 
Rorschach, both in the clinic and in academic 
settings, and has Spent two years teaching and 
supervising Rorschach work in a clinic. Й 

Judge С attended а Hertz “workshop” in 1946 
and has since used the test in a well-established 
clinic under expert supervision 


For purposes of control, two other 
raters were used in part of the experi- 
ment. The Rorschach experience of these 
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“nonexpert” raters is described in Section 
IV, Part 4. 


B. Tur Rorscuacn RATING SCALE 

A four-point scale was used for sorting 
the Rorschach: (I) very maladjusted, (17) 
moderately maladjusted, (III) fairly well 
adjusted, and (IV) very well adjusted. 
These scale points were not further 
defined. 


C. Turk SomriG PLAN 

The records were divided into four 
groups for the purpose of rating: 4! 
Guidance (G) group boys; 37 Guidance 
(G) group girls; 30 Control (C) group 
boys; and 38 Control (C) group girls. 
Three sorts into the four adjustment 
categories were made on each group of 
records, with successively increasing 
amounts of Rorschach information given 
to the judges on each. This plan was 
followed in order to determine the con- 
tributions of both the formal aspects and 
the content to the reliability of the 
ratings and the capacity of the tool to 
predict clinical judgments. \ 

For Sort 1, the only Rorschach material 
on each case consisted of the summary 
page of the standard Klopfer and Da л 
son scoring form, including the determi- 
nant profile and the standard percent 
ages and ratios. In addition, the raters 
were given the norms of this particular 
18-year-old sample, in the form of means; 
medians, quartiles, and per cent occur 
rence for each of the four groups. 

For Sort 2, the judges were given the 
previously mentioned summary page 
plus the tabulation page of the scoring 
form, which shows the distribution of the 

* The primary difference between the G (or 
dance) and C (Control) groups is the intensity 
with which (у have been studied through e 


s is " were 
terviews. Т.е Rorschach” administrations * 
equivalent for tie two groups. 
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scored variables over *he ten cards. On 
Sort 3, the raters were given the entire 
record, including the full protocol. 

1 The protocols were presented in a 
ii order, with this order changed 
from sort to sort. Any case-identifying 
Material was deleted, since one of the 
Judges had also acted as an interviewer 
E um S the children whose Ror- 
subject — used, but the sex of the 
с ый het кй. On each sort, both 
fated sie girls in the G or C groups were 
so ther ore continuing to the next sort, 
the A to two days elapsed between 
ena ing and rerating of the same Ror- 
LE records. The judges did not have 
Bact = their previous ratings. This 
fosse" the size of the groups sorted, 
ua S y minimized the memory factor 

= lal rating of the same records. 
Ties instructions to the judges were (a) 
Кос T. Anto consideration both self- and 
Кеч adjustment in their ratings, (b) to 
E fora normal distribution of ratings 
rate the four-point scale, (c) to bi М 
this adjustment in terms of the norms О 
TM group, and (d) to record separately 
this Cues used for individual ratings when 
5 was possible. 


After the three sorts were completed 
on all groups, the judges conferred in 
an attempt to make explicit the cues 
they had used in their ratings and dis- 
cussed specific cases in which disagree- 
ment occurred. 


IV. RESULTS AND DISCUSSION 
A. RATER BEHAVIOR 


1. Distributions of ratings over three sorts 

All of the judges found it difficult to 
approximate a normal distribution on 
the four-point adjustment scale even 
though they had been asked to attempt 
it and to rate in terms of this group. The 
distributions of the cases remained quite 
constant as more Rorschach information 
was given to the raters. (See Table 1. The 
distribution of cases was so similar for 
all judges that the results of the three 
es' ratings are averaged for this 
) On all three sorts for both boys 
and girls, 61 to 71 per cent of the cases 
were rated as “maladjusted” (Ratings I 
and II). With the exception of the first 
sor? of the boys’ group, the differences 
in the per cent of cases rated as "mal- 
adjusted" and those rated as "adjusted" 


judg 
table. 


TABLE 1 


PERCENTAGE DISTRIBUTION O! 


г RATINGS OVER THREE Sorts 


Girls (V=75)* 


A Boys (N=71)* 
сїн Р Adjustment Sort 
agony Sort Category 
3 T 2 3 
I 2 
| I 16% 16% 17% 
п ой MA 54 П 50% 49% 50% 
Iu 4040 MA 2796 Ill 26% 30% д 
p. V ME 2 IV MO 055 1% 
a o 
% % 100% 100% 100% 100% 
100% 10096 
j —very djusted 
Sort = Adj. category I—very maladj " 
рове p j ; [I moderately maladjusted 
pate plus Ad category III—fairly well adjusted 


Sort 2— Profile page plus tabulation sheet 


rt 3—Entire record including content 


E 
Sorts were done in four group: 


2 G boys, №= 41; С boys, 


Adj. category 
Adj. category 


N=30; G girls, N=3,; C girls, N=38. 


IV—very well adj usted 


e 
с 
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are statistically significant above the 5 
per cent level of confidence. Many more 
cases were rated as “very maladjusted” 
than were judged “very well adjusted” by 
all three raters. A larger percentage of 
boys than of girls were rated “very mal- 
adjusted” by all judges. There is some 
tendency for the percentage of boys 
placed in adjustment Category I to in- 
crease as more Rorschach information is 
given the judges. A corresponding de- 
crease occurs in the number of cases 
placed in Category IV. This change does 
not take place in the girls’ groups. 


2. Intra-rater agreement 


As more Rorschach material was made 
available over the three sorts, the judges 
tended to change the adjustment rating 
of approximately half of the cases by at 
least one category (see Table 2), in spite 


of the fact that the percentage of cases 


in each adjustment group remained 
quite constant. It might have been ex- 
pected that the greatest number of 
changes in rating would occur between 
Sorts 1 and 3. This was true in the ease 
of the girls’ groups, 


but not consistently 
in the boys’, 


Other sex differences are 
also evident. In the ratings of all judges, 
the least change for the girls’ groups 


occurs between Sorts 1 and 2, but for the 


boys’ groups, betveen 2 and 3. These set 
differences seem in line with many сше 
findings in the Guidance Study poe 
schach studies. That is, the content ре 
verbalizations (introduced in Sort 3) 0 


= E э - than - 
the girls' records are much richer t 


those of the boys’, and so might tend tO 
influence to a greater extent the change 
in the Rorschach adjustment ratings 
given to the girls. 


3- Inter-rater agreement 

Table 3 presents an affirmative dà 
мег to one of the questions raised in d 
introduction, namely, whether jc 
can agree on over-all adjustment Lae 
made from Rorschach protocols. ie 
though far from unity, the remachan 
correlations of inter-rater agreement a { 
show an acceptable degree of pd 
ship between the ratings of the ihre 
judges. t 

The sex difference is again apparen 
In rating the boys’ records, there 38 = 
increase in inter-judge agreement eni 
the first to the second sort and a slig " 
decrease from ihe second to the third 50! 
as more Rorschach information is we 
The correlations decrease slightly on je 
second sort for the girls, then increase ° 
the third. 


2 ial 
A comparison of the full and part 


TABLE 2 


IxrRA-RATER AGREEMENT: 
z EMENT: 
PERCENTAGE of Јорсеѕ’ 1 


SELF-AGREEMENT IN RATINGS OVER THREE Sorts и. 
" Boys (№= 71) Girls (V=75) 
| | Gids(N-79 — 
red bere Rater Per Cent of Cases Rater 
s : onstant Between: z ——— 
n B c CA B 
gorte д SR 2 61% 51% 54% Sorts т and 2 73% 61% ofp 
ie id 3 6375 5099 61% Sorts 2 and 3 61% 48% 52% 
5 3 56% 54% 54% Sorts т and 3 45% 43% 49 


Sort 1—Profile 
Sort 2— Profile 


page only e 


7'€ Page plus tabulatip, 
Sort 3—Entire record inc] T£ 


uding confent 


— r 
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TABLE 3 


CORRELA «sor IN 
ORRELATIONS OF INTER-RATER AGREEMENT ON ADJUSTMENT RaTINGS* 


| Boys (= 71) 


Girls ((N — 73) 


Raters S 
ort Raters Sort 
| 1 
rS T 
LL а. 2 3 I 2 3 
AXI 7 
3 КІ АХВ E .65 
AXC = == ILI 
Bet 207 АХС .45 .42 
: - бї BxC +73 50 


жос; 
Signifi 

ificance Š s 0а 

lificance of the tetrachoric correlations is ind 

t 1 per cent level, 

r cent level, ————— 


етану different from zero а 
gnificantly different from zero at 5 Pe 


agr 
үр of the judges’ ratings is shown 
Were so (Since all of the distributions 
better nie ewed, these are probably a 
Жө Г fave than the tetrachoric cor 
per aa e the three sorts, оп 29 
cent of е | the girls and 34 to 39 per 
completely boys, the three judges agreed 
given. а, е on the adjustment rating 
agreement. ш, to the cases of complete 
two fug ‚ we add those cases in which 
ges agreed on a rating category 


icated as follows: 
a 


oint only, 85 to 98 per cent of all 
cases are included. The other 2 to 15 per 
cent consist of those cases in which two 
judges agreed and the third judge dis- 
agreed by two scale points or in which 
the three judges gave three different 
ratings. In addition to the above-men- 
tioned lower percentage of girls than 


boys on which the judges completely 
agreed, Table 4 shows a higher percent- 
age of girls on which the judges com- 
pletely disagreed. 


scale p 


and ; 
the third judge disagreed by one 
ө 
ТАВІЕ 4 
DISAGREEMENT ON THREE SORTS 


INTER-RATER AGREEMENT AND 


Boys (N 772) Girls (N = 75) 
i Extent of Agreement Sort Sort 
H 2 3. І 2 3 
hree ; 
ree judges agree 39% 34% 38% 20% 2996 29% 
Two; 
© judges a, МР " 
apes. agree and third jud e dis- 
" Brees by one scale point = 46% 64% 58% 58% 62% 56% 
woj 
ри a agree and third judge dis- % 
" es by two scale points 8% 1% o% 4% 4% 376 
Wo jud 
ges a; а ird j ig: 
ар gree and third jud e dis 
1 Erees by three scale —— о% о% o% °% °% °% 
"hes; 
"ee judges disagree 7% 1% 4% 9% 5% 12% 
p oes 
100% 100% 100% 100% 100% 100% 


Ф 

Sort 1—Profile раве only . 

| | Sort — Profile page plus tabulation sheet 
Sort $—Entire record including content 
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It was expected that because of simi- 
larity of training and experience back- 
ground, Judges A and B would agree 
more highly with each other than either 
would with Judge C. Neither the evi- 
dence in Table 3 nor a further break- 
down of Table 4 into the agreements and 
disagreements of individual raters indi- 
cates any such tendency. The average per 
cent agreement of the judges over all 
Sorts is as follows: A with B, 56 per cent; 


A with C, 51 per cent; B with C, 58 per 
cent. 


4- Sorting by Rorschach “novices” 


After discovering the extent to which 
Rorschach “experts” could agree on 
adjustment ratings from Rorschach pro- 
tocols, the authors asked two more indi- 
viduals to act as judges in rating one of 
the four groups described in this paper. 
One of them, Judge D, has had many 
years of experience interviewing as a 
social worker. With respect to the Ror- 
schach, she can be considered “naive,” 
since her only experience with the test 

° 


INTER-RATER AGREEMENT (TETRA 
AND OF “EXPERTS” 


was as a subject a year prior to this study. 
Judge E is a graduate student in clinical 
psychology, who had, at the time of these 
ratings, taken a one-semester course in 
Rorschach administration. and scoring 
from Judge A. Since the formal scoring 
aspects of the records meant nothing tO 
Judge D and relatively little to. Judge 
E, they were given the entire protocols to 
rate. Thus, their one sort was comparable 
to Sort 3 for Judges A, B, and C. Judge 
D worked with the records of the C girls 
(N = 38) and Judge E with the records 
of the G boys (N = 41). 

Table 5 presents the inter-rater agree 
ment of the Rorschach “novices” with 
the “experts” and the agreement among 
the “experts” in the ratings of the groups 
with which the “novices” worked. Com 
paring these results, we find that Judge 
D's correlations with the original judges 
are only slightly lower than the “ех 
perts” agreements among themselves: 
and that Judge E correlates higher with 


Judges A, B, and C than they did with 
each other, 


TABLE $ 
CHORIC r's) OF RORSCHACH 


“Novices” "EXPERTS," 
WITH EACH OTHER, on COMPARABLE ёз me P 
SA Rater D Experts** 
s = Raters E E 
C Girls C Girls 
is ES AXB 
DXC p ANC 
249 BxC 
Raters CE c ME R 
i G Boys aters 
19 Ахв 
aes АХС 
| BXC 


Ci 


О! 


rrelations Presented hire do not appear in Та 


>— ог 
TOUDS were combi IR ee ement C 
equently the bined for the inter. rater agre 


t 
Table 3° 
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е Does the magnitude of the inter-rater 
pou among the "experts" mean 
mri Rorschach protocol as a be- 
е ере contains communicable 
does it e» concerning the subject, or 
tensive EMI mean that through in- 
judges E similar training, the three 
the El оа degree to do 
еле ibn. a when confronted with 
pave, vee a T The former may be the 
no vidus cee who have had little or 
Шш are able to make similar 
resi = a Rorschach records. Ap- 
years Б] ak eral months of training and 
d бошт e ience in the application of 
see fo. scoring system have con- 
the “exi Ше to the agreement. among 
called dig ts" when the discriminations 
scale. r are no finer than a four-point 


5 . 
5. 8 "m ‚ $ , 
ubjective impressions o the judges 
judas 


ie conferences of the “experts” 
анор their ratings made it clear that, 
ачи. is the raters individually were 
Prob] ned with different aspects of the 
di метр all three agreed that 1t was very 
ratin s to make over-all adjustment 
uae, from these Rorschachs. They felt 

confidence in many of their ratings. 


hey conti : poe 
ey continually reviewed their judg- 
o achieve a more 


m m 
€nts in an attempt t 
scale, 


Normal distribution on the rating 
iue unable to do so. They found it 
E: t to rate the adjustment of these 
Which. terms of the norms of this group, 
Was " were available to them, because it 
ч for them to depart from their 
lag notions of a ' normal” Ror- 
tions 1. For example, standard assump- 
dug, of normal Rorschach balance 10- 
Fo; е greater use of color and a lower 
Sam and 4% than are found in this 
ple. 
Жы he judges agreed 
ps presented quite di 


that: the boys’ 
fferent sorting 


problems from the girls’ groups. The 
girls’ records were much richer with re- 
gard to both formal aspects and content, 
and the judges felt that they offered 
much more basis for the adjustment 
rating. The greater poverty of the boys’ 
records, together with the judges im- 
pressions of general “ugliness” of con- 
tent, made it difficult for the raters to 
give them ratings of III or IV. In fact, on 
the final sort of one of the boys' groups, 
each judge independently failed to place 
any record in the "welLadjusted" cate- 
gory. 
On the above problems, the judges 
were in substantial agreement. In addi- 
tion, each of the raters raised particular 
issues which were of individual concern 
during the sorting process. Judge B felt 
it was necessary to distinguish between 
present adjustment and predicted future 
adjustment, since in many cases she 
would give different ratings. For instance, 
a girl of 18 whose Rorschach shows a 
tendency to relate only on a superficial 
level might be reasonably well adjusted 
in her 18-year-old peer culture, but might 
encounter difficulties with emotional re- 
lationships later. Judge A wanted to. 
emphasize the necessity of different ad- 
justment criteria for boys and girls in 
terms of the different cultural patterns. 
demanded of the two sexes. For example, 
while fewer W than D and a W:M ratio 
of less that 2:1 might be negative signs in 
a boy's record, they would not necessarily 


be so in a girl's test. 

ratings which the judges 
hich have been. discussed 
and which have been 
“sign” lists of David- 
the judges used them 


Many of the cues for 
verbalized were those w 
often in the literature 
utilized particularly in the 


son, Monroe, etc, However, 
not as isolated items but as parts of a configura- 


tion which determined their weights. A few ex- 
amples of other cues on which the judges were 
in essential agreement follow. Overemphasis on 
any particular blot aspect (tvo many W, M, Fc, 
etc., responses in proportion to the rest of the 


Tecord) was considered a Negative sign. The use 
ОЁ achromatic color or white space in a colored 
card tended to lower the rating. A large number 
of dd responses was a much more negative sign 
than a large number of dr. Imbalance between 
the amount of animal movement and the use of 
texture (few FM Tesponses and many Fe or 
many FM and few Fc) lowered the rating. Re- 
coverability after "shock" reactions moved the 
rating toward the "adjusted" end of the scale, 
The use of a variety of content was Considered 
à positive sign, The judges agreed that the pri- 
mary use they made of the content was to indi- 
cate basic conflicts and current upsets. 

Particular aspects of the Rorschachs were em- 
phasized differentially by the three judges, Judge 


stereotypy and lack 
Thus, for Judge С, an “adjusted” Rorschach 
meant an “ideal” o 
а test which was дү 

Judge B conceiy 
as being characterized by the 
response, T 


populars was especially considered, 
the handling of the animals on Card VIII аз 
representative of self-acceptance, Along with 
Judge A, Judge B felt that immaturity does not 


mean “ Broup. Nor was 
‚ Such as might be shown 
» Enough to give a “maladjusted” rat- 
ing at this age. 

Even more than Judge B, Judge A built her 
adjustment scale around the characteristics of 
this group. Thus, absence of color responses, 
stereotypy, and constriction of verbalization did 


not in themselves lower the adjustment ratings, 


particularly 


the absence of colo; 
combination wj 
conflict for her and 
adjustment rating. Juc g 


/ Specially con. 
scious of assigning differential Weightings to 
many Rorschach variables i 


5 апа relationships in 
male and fem For example, while 
K and FK were almost invariably negative signs 


ina boy's record, they were not necessarily nega- 
tive in a girl's Or a 1 

determined responses i 
animal-movement res, 
ing more than a Birl's 


It is interesting to not 


е these varying 
approaches of the judg 


es even though 
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this study does not purport to present E 
extensive analysis of the behavior p 
Rorschach interpreters, полин 
among the “experts” should not putri 
emphasized, however. It was as evic he 
from the conference of judges as from t Е 
correlations and рег cent € 
Presented above that the raters Es 
proached their task with much the Es н 
Rorschach attitudes, and that the "ies 
ences occurred primarily in the hierarc 
ОЁ cues rather than in the cues then 
selves, 


“naive” rater 

The notes made by Judge D, the naive = dme 
mentioned the following qualities as T 78 
portant in determining her ratings: Weg yer- 
quality of observation, originality, case ам and 
balization, affect represented, capacity О ок 
modify what Judge D interpreted as an the 
responses, defensiveness about the test igi dis- 
concepts seen, and degree of satisfaction с 
satisfaction with responses, үй 

Some of the Spontaneous recorded Sor nach: 
of Judge D would be of interest to Rorsc Cor 
trained people, as they show a startling Јову 
Fespondence го classic Rorschach PAR a 
апа interpretive practice, For example, nioys 
record with many good M's, she notes, es 
her acquired knowledge, Rich inner life; her 
tions of self of importance to self," Of ge 
With many white Space responses, she says, gett’ 
Out of way to see things, ignoring the clos nce! 
hand while doing so, Sounds like belligere! 
looking for trouble." ‘ont à 

Judge E, the "novice" rater, used core ssed 
Breat deal, “as in a TAT.” The affect EXE Кат 
by the subject Was important їп making те 
ratings, as were the kinds of M’s and coan Jo- 
sponses, Responses given to infrequently use 
cation areas lowered her ratings, 


6. Relationship 


P to 
Of judges ratings 
Davidson Adjusty 


nent Signs (1) 


In the process of making explicit i 
cues, the “experts” often justified "by 
adjustment ratings they had given n- 
listing many of the Rorschach qub 
Ships included in the adjustment m 
lists. This was true even though pd 
judges wefe aware of nonsignificant im 
lationshipssbetween the "signs" xo 
terview ratings of adjustment (5). 


еа 
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P TABLE 6 
ORRELATIONS BETWEEN JUDGES 
NS BETWEEN JUDGES’ RATINGS AND THE Dav 1 
ATINGS AD = DAVIDSON ADJUSTMENT SIGN 
s 4 MEA IGN List* 


Girls (V=75) 


Boys (V= 
pe Sort Judge 5 
_ mE ed | Sort 

ТЕЗИ _ | i Е 2 3 I 2 6 
A = Е 2 ” 
B A ‚43 .29 аз 
е " Sin 36 ES 
D "SS - EU +23 35 
E (G boys, e E (С girls, V=38) 12 


* Gienifi 
Sigr ae 5 а 
eo emce of these biserial correlations is indicated as follows: 
Significantly different from zero at 1 per cent level, 


Significantly different from zero at 5 per cent level, ———_—— 


did not seem to use the "signs" in an 
tear in which each addi- 
seine 4 sgn present r sed the adjust- 
o ating. The context in which the 
E oui ме determined. its impor- 
ime ifs bs. абра indicator. Yet, 
ird 1c signs were so often mentioned 

the judges’ conference, we were curi- 
Ous to know how the ratings correlated 
With the "sign" scoring on the same 
records, The correlations are presented 
m Table 6. 

We have evidence that the “signs” are 
being used to some extent, since the 778 
are all positive. But many other cues also 
seem to play a part in determining the 
final subjective rating. Because the Dav- 
idson list is based primarily on the 
formal aspects of the test, we would 


expect to find the highest correlations 
first sort, when Ror- 
eing used. The 


With the judges’ 
Schach content was not b 
table shows no consistent change over 
the three sorts, however. The impres- 
Sion of Judge C, that she was least in- 
fluenced by the formal aspects of the test 
and most influenced by the content, is 
Confirmed here. Her correlations with the 
signs” are slightly lower than. A's or B's. 

As would be anticipatéd, the Ror 
Schach ratings of Judge D correlate low- 


est of all with the formal "sign" list. The 
correlation for Judge E is in line with 
those of the "experts." 
B. VALIDATION 

1. The criteria 

Throughout this section, the G and C 
groups will be discussed separately, since 
the outside criteria of adjustment consist 
of ratings made on a somewhat different 
basis for the two groups. The primary 
differences concern the intensiveness with 
which the cases in the two groups were 
studied. Both С and С groups took part 
in the same testing program. In addition, 
the G groups were much more inten- 
interviewed and received yearly 
any personality dimensions, 
e scales of adjustment. For 
orrelation with our judges’ 


ratings from Rorschachs, two case work- 
ers who had known and interviewed the 
G group subjects for many years were 
asked to make current adjustment 
ratings on those cases with which they 
were most familiar. Their ratings were 
estimates of current adjustment on four 
of the scales (self-adjustment, social ad- 
А, social adjustment В, and 
hich had been rated 


sively 
ratings on m 
including th 
purposes of c 


justment 


family adjustment) W 
at each yearly interview. Thus, the G 
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group case workers had available as a 
basis for their ratings transcripts of 
yearly interviews with the subjects and 
previous ratings on the same scales. 

The interviews on which the ratings 
were made might be called “diagnostic,” 
in the sense that certain basic areas were 
systematically sampled each year and 
then evaluated in codified form so that 
standard material was obtained on every 
child. Thus, the ratings were based both 
on behavioral information reported by 
the mother, the child, and the teacher, 
and on the observations and inferences 
of the case worker regarding relation- 
ships and attitudes. The coding was gov- 
erned by an overall description of the 
area to be coded and by an individual 
definition of each of the points on the 
five-point rating scale. These code book 
descriptions and definitions are presented 
in Appendix A. 

For the C group, special current rat- 
ings were made by the case worker who 
had known the subjects over the entire 
span of the study. These ratings were 
made using the same definitions afid 
codes of adjustment, but were based on 
more casual observation of the subjects 
during testing sessions at the Institute 
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and objective reports concerning the 
functioning of these individuals in the 
home, in the school, and on the job. 
The distribution of the case workers’ 
ratings for the four adjustment scales is 
given in Table 7. In contrast to the 
Rorschach adjustment ratings, they show 
a fairly normal distribution of the 
ratings over the five scale points. The 
ratings of the C boys (previously men- 
tioned by the Rorschach judges as the 
group having the most disturbed con- 
tent) show some skewness with a high 
percentage being rated 1 or 2 on all of 
the scales except family adjustment. ot 
the C girls, 56 per cent are rated as 
having Very good (ratings of 4 or 5) 
family adjustment. i 
Table 8 gives the intercorrelations 
among the case workers' ratings on the 
four different scales of adjustment. All 
of these correlations are significantly 


different from zero in a positive direc . 


tion. There are probably two factors 
involved: some halo which is operating 
in the case worker's evaluation of each 
child, and a certain degree of true rela- 
tionship among the various areas of 
adjustment. These high intercorrelations 
among the four ratings on each subject 


TABLE 7 
PERCENTAGE DISTRIBUTION or Case Workers’ RATINGS OF ADJUSTMENT 
LE Self Soc. A Soc. B Family Self Soc. А Soc. B Family 
g PERO Rating 
oys (N — 41) С Girls (N 737) E 
5 2% 10% a% зор 5 @ 
8 30 
í RB OW) XP 5| iod c oS d 
3470 o 41% 3 09, 39, 9% 43 79 
‚2 41% A% 240 ооф ns po WS 2 - 
т 2% o% o% 7% а 582 90 K СА 
C Boys (N — 30) C Girls (N 38) 
5 13% 3% 10% 279 5 1 2475 
Pom Ww Om Si God u 
(] (Л 33/0 40% 3 24% 2 
2 337b 37% ^ 40% тоб OA ES. 60 
: 5 A 2 21% 24% 37% 
A o% o% 7% I 29 5% 3% LER 


JUDGES’ RATINGS OF ADJUSTMENT ON THE RORSCHACH 1 
1 
= TABLE 8 
NTER BLA T i ^ 
CORRELATIONS AMONG THE CASE WORKERS’ RATINGS ON Four ADJUSTMENT ScaLES* 
| - | | 
u G Boys | G Girls 
| Self Soc. А Soc. B Family Self Soc. А Soc. B Family 
Self | ў x К 
E Self 262 42 
ч u 3 pe б. 
Soc. В | " c» : == = 
ос. 
| | -49 
| | 
Self ркаш 
Self 7 
Soc | E > 
> A | Soc. A s 3 
Soc. B | Soc. B | XI : 
| А | 66 


* Si . 
ignificance а ЕГ 
gnificance of these Pearsonian correlations is In 


dicated as follows: 


Signihcant at the .or level of confidence, === 
Significant at the .os level of confidence, ————— 


will leà k Уы R 4 
of on to few differences in correlation 
he Rorschach ratings with the differ- 


ent areas : ш P 
nt areas of adjustment rated from inter- 
Views, 


2. Rhe results 


7 старце correlations with the criteria. 
Бейге 1 gives the Pearson correlations 
ШЕП E the Rorschach ratings of adjust- 
EL the case workers ratings of 
z ment for the four groups of sub- 
n glance at this figure suffices to 
ablish the most general interpretation 
oe désalis- castel, that there is no 
леше of a significant positive relation- 
Ship between the Rorschach ratings and 
the other measures of adjustment. Of the 
144 correlations represented in the figure, 
only six are significantly different from 
zero at the 5 per cent level of confidence. 
The majority of the correlations cluster 
around zero, two-thirds of them in à 
Positive direction.* 
ры the ratings of the Rorschach “nov- 
relations е po a Шү: pates phos 
x or Pres Tots орин the cate 
Workers’ ratin >, of s Га] istments +-33 with 
Social adj и ey it social adjust- 
justment A, +.33 with socia ] 


This low positive trend in correlations 
between interview-judgments and judg- 
ments based on projective techniques is 
a frequent finding in clinical research. 
It is in line with the tentative results of 
the research in assessing Veterans Ad- 
ministration trainees now being con- 
ducted at the University of Michigan (6). 
Guilford (8. p. 5) in discussing the ex- 
tensive research in the aviation service 
during the war, says: К 
onclusion that was brought 
home to us by repeated experience is that we 
should have greater respect for low correla- 
tions. Tradition has taught us that unless CO- 
efficients of correlation are substantial, for ex- 
ample 40 Or above, there is too little relation- 
ship to bother with. We must face the fact, un- 
pleasant though it may be, that in human be- 
havior, complex as it is, low intercorrelations 
of utilizable variables is the general rule and 


not the exception. 


One general с 


d —.10 with family adjustment. The 
significant. at the .05 


two 4-83 correlations are 
level. The ratings by Judge D of the C girls ccr- 
relate 4-11 with the caseworkers’ ratings of self- 


adjustment, —.03 with social adjustment A, —.05 
with social adjustment В, and -+.03 with family 
adjustment. (These correlations, based on ratings 
by the Rorschach “novices,” are not included 


in Figure 1.) 


ment B, an 
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TABL 


RESULTS OF ANALYSIS ОЕ VARIANCE OF THE z 


E o 


S FROM EACH or THE Four GROUPS 


F Based 


= vel of 
on Triple Level of F Based posh 
Source = of df Variance Interaction pale on Toe pen 
" /ariance dence atior 
Squares Varianc ae 
G Boys (N=41) _ -A 
r 604 6.45 oi 
Sorts -041208 2 ого 6.45 оз wie 
Interview Scales -706404 3 -235468 73-75 .оот 8 94 99 
Judges X Sorts -318733 4 -079683 25.44 оо! 3 
Judges X Inter- В E К 
iew -131260 6 -021876 7.86 2001. E . 
Ass Eon intention Variance = -0040426 Population \ ariance ён ыр 
G Girls (N=37) “д Е 
Sorts -095838 2 -947919 5-32 05 
Interview Scales -224327 — 3 -074775 8.28 2001 aum 
Triple Interaction Variance— 0098249 Population Variance = 1020412 


C Boys (№= зо) 


udges -039210 2 -019605 4-51 .05 
фир -091696 2 -045848 10.51 -OOI 
Interview Scales -214182 3 -071394 16.41 -OOI 
udges X Sorts + 209501 4 -052375 11.33 poor Y 
Judg Triple Interaction Variance= -0041409 Population Variance = + 037037 
C Girls (N= 38) = 
ee - 
Judges -243016 2 -121508 56.11 ‚оо 4.28 +05 
Sorts -071579 2 -035789 16.52 +001 
Judges X Sorts + 208117 k 4 -052029 23.90 soor _ 
Triple Interaction Variance = -0028245 Population Variance = -028571 8 
— — 
pect much difference among the judges subjects is th 


in the matter of validity. 

(2) Differences among the three sorts 
in correlations with the criteria, Vari- 
ance from one sort to another is signifi- 
cant in all four groups. Obviously, how- 
ever, it is not in a consistent direction. 
with the criteri: 


The only in teraction 


Which is signif- 
icant for three of the 


four Broups of 


at of judges and Sorts. m 
ords, the judges are acting oe 
ently on the different sorts in terms'o 
their correlation With the criteria. That 


this is the case 15 obvious from inspe 
tion of Figure 1, 


other w 


(3) Differences among the interview 
scales in correlations with the Rorschach 
ratings. There is one F significant at the 
:001 level of confidence when we use the 
Population variance as the divisor. b 
is variance among the correlations with 
the four different interview scales for the 
G boys. The Majority of the G boys were 
rated by one case worker who apparently 
(see Table 8) made greater шош 
tions among е four types of adjustmen 
than the othe: raters. Using the triple 


à 
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interaction variance in the F ratio, the 
correlations vary significantly among the 
four interview scales for all отор: ех- 
cept the С girls. Ап inspection of Figure 
б © 
1 will show that the judges’ Rorschach 
ratings correlate more highly with the 
casa workers’ ratings on the scales of 
social adjustment than with ratings on 
the other adjustment scales. All of the 
significant correlations are with the two 
Social adjustment scales, while the major- 
ity of the correlations with family adjust- 
ment are low negative. 

i Combining the impressions from all of 

"s data, one is led to the conclusion 
that perhaps the most interesting aspect 
А the study is not the subjects, their 
ноты and their case histories, but 
à orkers themselves, the Rorschach 
judges, "expert" and “naive,” and the 
sap beni Had we limited our study 
з boys only, for example, our con- 
‚ clusions might have been clearer and 
more confident than they are when we 
check them with results from the other 
three groups also. One major difference 
among the groups arises [rom the case 
workers’ ratings of the subjects. For ex- 
ample, the mean interscale correlation 
for, the worker who rated most of the G 
boys was .50, whereas the mean for the 
worker who rated all of the C cases was 
“70. This fact alone, since the Rorschach 
judges rated on only one scale, would 
influence the difference in correlation 
with the four scales which shows up 1n 
Figure 1. 

c. Case studies. In a further attempt to 
explore the relationship between the two 
types of ratings, some individual cases 
with wide discrepancies were studied. 
"There were seven cases whose Rorschach 
ratings were in the fourth quartile and 
whose interview ratings we-¢ in the first 
quartile. There were six, Cases whose 


Rorschach ratings were in the first quar- 
tile and interview ratings were in the 
fourth. The histories of those discrepant 
cases from the G group were thoroughly 
perused without any hypotheses in mind, 
in the hope that they might suggest hy- 
potheses which could be checked against 
the cases from the C group. To a certain 
extent (even more than one might expect 
with such a small number of cases), this 
was successful. 

Five of the seven cases whose Ror- 
schach ratings were much higher than 
the case workers' ratings had very similar 
family patterns. These included desper- 
ately severe economic insecurity during 
childhood, much marital conflict be- 
tween the parents with threatened sepa- 
ration and divorce, and siblings who, 
these conditions, became delin- 
n all of these cases our subjects, 
although they certainly had problems 
and tensions, might be described as the 
best adjusted members of very poorly 
adjusted families. Perhaps their “good” 
Rorschachs reflect the capacity to make 
s@me sort of adjustment to an almost 
impossible environment. The сазе work- 
ers’ ratings, on the other hand, used the 
whole study group as а reference popula- 
tion, i.e., the subjects were rated on their 
adjustment relative to the other subjects 
in the group, not relative to the job of 
adjusting they had to do. It is interesting 
too that absorbing interests in music or 
religion or both were common to all of 
these subjects and may have been im- 
portant factors in their adjustment. 

The pattern in the six cases whose 
interview ratings were high and Ror- 
schach ratings low is not quite so clear. 
Three of these subjects have in common’ 
a high socioeconomic status, which has 
d in smoother life circumstances 
the children in the 


under 
quent. I 


resulte 
for them than for 


16 


other group. There is no doubt that 
they are attractive young people, socially 
successful in a school system with definite 
social hierarchies. The conflicts resulting 
in a “poor” Rorschach have perhaps not 
been precipitated and resolved in this 
smooth, non-tension-producing environ- 
ment. Another two cases are quiet and 
unanimated, with relatively low IQ's for 
our group and a low level of aspiration; 
they have accepted their personal and 
social liabilities and appear to the case 
worker on these grounds to be adjusted. 
To the Rorschach worker, however, real 
adjustment is questioned because their 
Rorschachs seem flat and withdrawn. 


V. SUMMARY 
The Rorschach records of 146 normal 
18-year-olds (71 bo 
rated for over-all 


point scale by three Rorschach “ 


schach were used; 
or sort, the distri 
gories over the ten cards was includ 
in the final rating or thir 
Protocol was used. Dat: 
rating trials or “sorts” 


in the second rati 


bution of these cate. 


led; 
d sort, the whole 


a from the three 
were Separately 


bers of the Guid- 
tute of Child Wel- 
Огпіа. The re- 
and 38 girls (С 
а matched сопїго1 
ce Study апа had 
tensively over the 
- For Purposes of 


group in the Guidan 
been studied less in 


Same period of time 
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validating the Ror-chach ratings 
ratings of adjustment made by case work- 
ers, these four groups were treated Sep 
arately, since the amount of information 
available to the case worker as a basis for 
adjustment ratings differed in the G and 
C groups. 

The Rorschach judges consistently 
placed from 61 to 71 per cent of the cases 
on the “maladjusted” end of the four- 
point scale. However, the magnitude of 
the inter-rater agreement correlations 
showed that “experts” can agree, not 
only among themselves but also with 
judges having little or no Rorschach 
training, (Two other judges, one of 
whom had only a few months of Ror 
schach training and one of whom had 


absolutely none, rated a small group of 


records.) In verbalizing their cues, nm. 
experts” mentioned many of the forma 
Davidson adjustment signs (their rating 


correlated +.23 to +.56 with the David- f 


son list), but indicated that the signs 
were weighted with regard to the total 
context and that many other less ob 
Jective cues were also used. 


Concerning inter-rater agreement, 
: - dis- 
there was no particular advantage ot a 
ady 


antage to using the full Rorsche¢h 
protocol over the formal aspects alone 
With the addition of content, the raters 
changed more of the girls’ ratings tha? 
the boys’, There Pa more consistent 
inter-rater agreement on boys’ records 
than on girls’ within a single sort, ane 
More consistent intra-rater agreement OP 
boys’ records than on girls’ between sorts: 
More boys than girls were rated as “mal 
adjusted.” This is in line with the results 
of our analysis of “neurotic” signs (5), 
in which the boys consistently receive 

higher Scores, and the analysis of adjust 


I i T : receive’ 
ment signs (5); in which the boys тесеу 
lower Scores 

* 


рли 
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Corretations of the Rorschach ratings 
with the case workers’ adjustment ratings 
were primarily low positive. The lack of 
a statistically significant relationship can 
lead only to the conclusion that the Ror- 
schach, used blindly (ie. without sup- 
plementary background and observa- 
tonal data) is of little value in predicting 
adjustment ratings made primarily on 
the basis of interviews and case histories. 
А Within this framework of no validat- 
x preme however, a few interest- 
iin ndy emerge. Those Rorschach 

tings which did correlate significantly 
vi the criteria were with ratings of 
social adjustment. The correlations with 
а adjustment tended to be negative. 

Iscrepancies among the results with the 
different workers point up the difficulty 
of using clinical judgments as validating 
criteria, A few individual cases with 
wide discrepancies between the two types 

of ratings were examined and interest- 
ing personal and sociological concomi- 
tancies observed. These coricomitancies 
are worthy of verification by further in- 
vestigation. As yet, however, the sources 
of the discrepancies between the Ror- 
Schach ratings of adjustment and the in- 
teryiew ratings remain undetermined. 
It is suggested that differing social back- 
ground of the subjects may be respon- 
sible for some of the discrepancies; socio- 
logical biases of the case workers may 
also be influential; and finally, of course, 
there is the possibility of inadequacies 
both in the Rorschach and the interview 
data, as such. 


VI. CONCLUSIONS 


Alter hearing of the results of this 


study, an academic psychologist said to 
the authors, "Now are you finally ready 
to give up the Rorschac?" That, of 
course, is too siniple. We know that a 


Rorschach interpretation can add mean- 
ing to the understanding of an indi- 
vidual case. But it is true that our con- 
fidence in the ability of Rorschach work- 
ers to analyze records of normal subjects 
for use in group research has suffered. 

The authors would like to suggest five 
possible sources of the negative results 
in our validation attempts, only one of 
which is the Rorschach itself. 

1. One of the difficulties may lie in the 
nature of our sample. It is primarily a 
normal sample with no pathological ex- 
tremes, and finer discriminations than 
are obtainable bya brief four-point scale 
are necessary to differentiate homogen- 
eous samples. 

2. The Rorschach may represent such 
a limited behavior sample, so sensitive to 
temporary disturbances, that it is not use- 
ful for predicting "adjustment" in other 
situations or at other times. Or the test 
may pick up such evidence of instability 
as exists in the individual without ever 
tapping his areas of stability. The Ror- 
schach may offer us по picture of present 
adjustment but rather predictions which 
only time and situational concomitancies 
can test. This projective technique may 
be one which will give us knowledge only 
of the subject’s inner potentialities and 
functioning, never of his overt behavior. 
Another point which arises involves the 
theoretical question of the function of 
fantasy. If one subscribes to the theory 
that fantasy offers a “safety valve” device 
for many individuals, then, of course, 
we would expect no one-to-one relation- 
ship between the pictures of adjustment 
oresented in the overt and covert areas. 

g. The third possible source of our 
negative results is the Rorschach rater. A 
large part of Rorschach training con- 
sists of learning to recognize signs of 


abnormality which have been established 
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on pathological samples, with little at- 
tempted comparison with randomly se- 
lected normal groups. Our raters have in 
common with other Rorschach workers 
this background of training and vicari- 
ous experience through the literature, 
which has sensitized them to the conven- 
tional indicators of maladjustment. 
Evidence of this concern is to be found 
in the distribution of their ratings in 
which the majority of cases were rated 
“maladjusted.” However, the positive 
correlations of our "naive" rater with the 
other judges and her zero correlations 
with the validating criteria indicate that 
the problem does not lie completely in 
stereotyped thinking and training on the 
part of our “experts.” 

4. A fourth series of problems con- 
cerns the criterion variables used, 
namely, case workers' ratings of adjust- 
ment. Although all case workers used the 
same rating scales, they were often of 
different theoretical orientation. While 
all had access to previous case records, 
they varied with regard to the length of 
time they had known the subjects, the 
degree of openness of the relationship, 
and thus with regard to their under- 
standing of the dynamics of the cases. 
The difficulty posed by differences be- 
tween the G and C groups with regard 
to intensiveness of knowledge about the 
cases further complicates our attempts 
to pin down the factors involved in our 
negative results. 
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5. A fifth possible factor in ‘the inter- 
pretation of our results is the semantic 
difficulty inherent in the use of the con- 
cept of adjustment. The concept of over- 
all adjustment, used by the Rorschach 
raters, is too broad and too vaguely de- 
fined. The meaningfulness of so inclusive 
a concept of adjustment, without regard 
to time, place, or area of functioning, 
may be questioned. Further, the concept 
of adjustment used by the case workers 
was specified as to these variables, while 
that used by the Rorschach raters was 
not. : 

These considerations have some im- 
plications for future validation attempts 
with the Rorschach. Research clinicians 
using this tool might well spend more 
time and effort collecting and studying 
the records of adequately functioning 
individuals, in order to counteract their 
biases in the direction of abnormality. 


The results also suggest that narrower, 


much more specific areas of personality 
be studied through the Rorschach for 
ease in finding suitable validating cri- 
teria. Another point, which has been 
made many times before, might be re- 
iterated here. Much more meaningful 
results may be obtained when we set,up 
our experiments so that the Rorschach is 
not tested in isolation, but rather inves- 
tigated in terms of the additional pre- 
dictive significance which it gives in 
combination with other clinical meas- 
ures. 


APPENDIX A 


Adjustment to self (size, sex, physical make-up, 

abilities, disposition, past misdemeanors, etc.) 

(1). Extreme lack of confidence shown either 
through excessive self-depreciation, unfavor- 
able comparison, or marked braggadocio. In- 
tense guilt feelings, or feelings of inade- 
quacy. 

(2). Not as marked as 1 but marked unacceptance 
of one or two items of make-up, However, 


if to the point of dominating whole per 
sonality, classify under 1. Or many mild 
points of discomfort. Over-adjusts to others 
at own expense. 

(3). Lacks confidence in some particulars but for 
the most part is unself-conscious or unaware 
of assets oy liabilities. Occasional tension OY 
conflict about self but not characteristic. 

(4). Recognizes Landicaps but accepts them real- 


х. 
e, MT 


Б ap ILC. 


| 


JUDGE 


istically and without much tension. Little 
г evidence of compensatory behavior. 
(5). Full of confidence—accepts limitations and 
те assets easily. ” 
ЕНН 25 family (codings on the s verity of 
Ет у еШ. it involves one or more family 
s, including step-parents. Tension-pro- 


* ducing relati i 
ng relationships whether shown openly or by 


peas or in compensatory demonstrative- 
grown En intense attachments ог such in- 
ois to auionships that normal, friendly rela- 
(1). трча ате precluded). | 
feels ps hostility or insecurity with parents, 
CS Lu is not loved, discriminated against, 
cde mect parents. expectations or sibs’ 
Faulks pis hments. Humiliation over parents 
2 s, occupation, income, etc. Child sub- 
еп to’ rather intense, ambivalent swings- 
(8), саи по compensatory satisfaction. 
e trends, but not so extreme as in 1. 
Much more strain than average but some 
Sources of security. Very poor relationship 
with one parent. If this poor relationship is 
with a parent with whom he seldom comes 
in contact, it should be included here un- 
less it dominates his other family feelings, 
(9). E which case the coding is 1- | 
or the most part, low-grade tension; not 
markedly unsatisfactory, but enough inse- 
curity in relationship to family members 
t^ make for strain or chronic low-grade em- 
barrassment over family members; mild 
( jealousies, 
4 Absence of real strain—occasional episodes of 
insecurity or lack of outstanding satisfac- 
T tions. 
(5). Complete security in family affection, par- 
ents, sibs, Genuinely proud of parents or а 
Yealistic (unembarrassed) acceptance of par- 
Cats’ faults, limitations, Or assets. No evi- 
dence of tension-producing attachment. 


Social adjustment 

techniques, 
ptance, 
incurs 
ity. Emphasis is 
r than on child's 
s—this last being 
shyness, friendli- 


Security i igi 

үч in social situation 

ended under such items as 
55, quarrelsomeness, etc-) 


S” RATINGS OF ADJUSTMENT 


(1). 


(5). 
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Extremely unsuccessful in social relations. 
Intensely disliked or resented by prac- 
tically all of his playmates. Very poor 
social techniques and constantly does 
things which offend his social group. Ac- 
tively avoided. 


‚ Unsuccessful in social relationships; not 


popular but does not give rise to the in- 
tense reactions of 1. Ignored or not spon- 
taneously included in group play, etc. 
Does things which annoy. Definitely dis- 
liked by many children; has some sup- 


porters. 


. Not outstanding. Normally successful in 


having people like him. Some playmates 
may not like him but has approving sup- 
porters. Or successful with one sex but 
unsuccessful with the other. 


. More popular than the average; has good 


social techniques. 

Unusually successful in social relations. 
Inspires friendliness or loyalty. Has many 
people devoted to him. Constantly gives 
rise to such statements as, "Isn't he a 
swell guy?" "She's a. grand person," etc. 


B. (Refers, as used here, to child’s feeling of 
tension or confidence and satisfaction in social 


relations) 


(0. 


(3)- 


. Likes children very much; 


Acutely uncomfortable, dislikes people, 
feels he is treated unfairly or is disliked 
by others. Chronically sulks or is aloof. 
Definite but less acute tension than 1. 
Feels he is not liked as well as other chil- 
dren. "Children don't play with me 
much." Or worried because one or two 
children dislike him. Insecurity may take 
form of shyness or aggressive attempts at 
social overtures. 

Takes his social relationships for granted, 
doesn’t occur to him to consider whether 
he is liked or disliked. Some frictions but 
"have as many friends as most children 
do.” May have few friends but apparently 
has no tension or worry on this score. 
Feels secure with one sex but a bit un- 
easy with the other. 

More confidence in soci 
than average. Very little 
many satisfactions. 


al relationships 
tension and 


enjoys being 
Js enthusiastic and happy in 


with them. 
feels socially secure. 


relations. Con fident, 


. DUNLAP, J- W. AND McNamara, W. Н 
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Thanks are also expressed here to the sixty subjects comprising the 
human raw material of the research. Without the willing cooperation ? 
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SOME PERSONALITY CORRELATES OF RELIGIOUS ATTITUDES, 
AS DETERMINED BY PROJECTIVE TECHNIQUES 


L PURPOSE * 


үү ORIGINAL purpose of this study 


was to determine the “emotional 
Maturity” of religious conservatives and 
liberals by means of projective tech- 
niques, Willoughby (21), Woodward 
(28), Symington (16), and Shrout (14) 
have made investigations by means of 
questionnaires of the emotional char- 
acteristics of religious persons. With the 
exception of the last, these investigators 
have concluded that generally liberals 
are more "emotionally mature" than 
Conservatives. According to Shrout’s find- 
ings, however, the degree of religious 
attitude toward God and the nature ofa 
person's religious experience (in our so- 
ciety and culture) has little or no bear- 
ing on his score on the Willoughby 
Emotional Maturity” scale. 
А Since the writer found the concept of 
emotional maturity" loosely defined, 
the aim was adopted of comparing 
religious liberals and conservatives on 
specific personality variables which au- 
thorities consider to be measures of ad- 
justr:ient or maturity, emotional, intel- 
lectual, or social. An attempt was made 
to saraple widely from such character 
istics, presumably measured by the tests 
Which were employed in the study. 

As might be expected, the terms "con- 
servative" and "liberal" are likewise in- 
adequately defined for scientific usage. 
"Therefore, two groups of persons were 
selected for the proposed comparison, 
differing not only significantly but wide- 
ly from each other on two religious at- 
titude scales; so that “conservative” and 
“liberal” are understood here to mean 
‘as defined by the two selective tests” 


(described in Section Ш). 


Hypotheses which were set up for 
guidance of the study were stated as 
follows: 

1. Religious liberals are more “emo- 
tionally mature” than religious conserva- 
lives. “Emotionally mature” was taken 
as “maturity in general.” It was con- 
sidered that a favorable balance on the 
liberal or conservative side of a number 
of personality factors accepted by most 
authorities as representing adjustment 
would tend to prove or disprove this hy- 
pothesis. These factors were specifically 
stated in terms of scores on the personal- 
ity tests employed. 

2. Rigidity of personality structure 
and conservative religious attitudes are 
positively correlated. 

3. Different iypes of emotional con- 
trol are found in both groups, so that 
the same external type of behavior, 
classed as mature or immature by both 
subject and observer, will be found to 
issue from different forms of emotional 
organization. 

4. Conservative individuals are more 
guilt-ridden than liberals. 

5. Liberals tend to gloss over aggres- 
sion-provoking situations more than con- 


servatives. 
6. A greater need for 
found in the conservative. 


dependence is 


П. SUMMARY OF RESEARCH 


An outline of the over-all procedure 


employed to test the above hypotheses is 


presented here: 
1. A preliminary selection of churches 


representing conservative, liberal, and 


“mixed” congregations, total of 21. 
2. Securing of cooperation of pastors 


and/or leaders for nonselective lists of 


[I 


persons in churches. 

3. Distribution of Salvation Opinion- 
naire by mail and directly through 
church groups, total of 1035. 

4- Simultaneous distribution of blank 
for identifying information. 

5. Division of the first group of re- 
spondents, 351 persons, into two main 
“populations” representing liberals and 
conservatives. Selection of possible sub- 
jects from persons about the submeans. 

6. Administration of Ferguson (re- 
ligious attitude) scale and Wonderlic 
Personnel Test (intelligence) to possible 
subjects to obtain зо subjects for each 
group. (Elimination of 20 persons out of 
80 possible subjects on the basis of low 
Scores on Wonderlic, or on the basis of 
Ferguson scores not in accord with Sal- 
vation Opinionnaire; these 
called "eliminees" hereafter.) 

7. Administration of Rosenzweig Pic- 
ture-Frustration Study, Thematic Ap- 


perception Test, and Rorschach to sub- 
jects. 


persons 


8. Transcribing, scoring, etc., of test 
Protocols; statistical treatment of scor- 
able data. 

The location of the rese. 
Southern California in tw 
tically contiguous cities, representing 
populations of considerable variety of 
background. Research was conducted in 
the summer of 1949. 

Religious populations were found in 
21 churches, 17 in one city and 4 in the 
other. Denominations included are: 
Baptist, Church of God, Congregational, 
Friends (or Quakers), Lutheran (Missouri 
Synod and American Lutheran), Meth- 
odist, Mission Covenant, Presbyterian, 
Unitarian, and Universalist. Independ- 
ent churches include: Pentecostal Taber- 
nacle-type (Baptist doctrine), and Unity- 
type (Theosophical—semi-Christian Sci- 


arch was in 
О large, prac- 
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ence). All but the first and the tast above 
contributed at least one subject to the 
study. , 


Лох 


Identi ng information concerning 
the 6o petsons who participated as sub- 
jects of research is given in Tables 1 and 
2. Note that in spite of an attempt to 
keep subjects Liberals 
mean age and educational level differed 
significantly from those of Conservatives 
at the 5 per cent level. Conservatives 
mean occupational rating (higher mean 
signifies lower status) was significantly 
higher than Liberals’ (2 per cent level). 
It is also to be noted that men and 
women were distributed evenly in each 
group. 


comparable, 


HI. SELECTION AND USE OF TESTS 

Since the study was to depend ex 
clusively on tests, the selection of tests 
was considered important. The Salvation 
Opinionnaire has been satisfactorily 
validated both by a chi-square «ite! 
analysis on a large population and by the 
judgment of qualified individuals (19): 
Ferguson's Primary Social Attitude No. 
t developed by means of factor analysis 
(7, 8) and administered to two inde 
pendent student populations, was found 
to denote what Ferguson believes is an 
operationally stable factor, Religionis™- 
The Pearson product-moment + between 
these two measures on the writer's sub- 
jects and eliminees together is .79; ОП 
subjects alone r is -77. Both of these co 
efficients are significant at the 1 per cent 
level. 

Form F of the Wonderlic Personnel 
Test was found to be satisfactory fron 
Several standpoints: its ease of admini* 
tration; its twelve-minute time limit: a 
adequate reliability (r: .88 to .94 оп A 
even items on different forms); its vali 
ity in beth practica! personnel selection 


EN 


^ 
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"s compared with its parent, the Otis 
Self-/ ini 1 1 
Administering Test of Mental Abil- 


ity, Higher Examination "= to 87); 
and lastly, its disarming titlehy(22). 


Го obtain as wide a sampling of per- 
sonality structure and functioning for 
Im of "maturity" factors, the 
Rosenzweig P-F Study, the Rorschach, 
and TAT cards 2, 3BM, 3GF. 4 6GF, 
8BM, 11, 14, 15, and 16 were selected. 
Pin н utilization of tests makes the 
m Er of the study dependent on 
roin : ity and reliability of the instru- 
| as well as the reliability of the 
scorer. None of the projective tests €m- 
ployed has proved itself to the same 
degree оГ statistical satisfaction that 
other more “objective” tests have proved 
themselves, although the clinician be- 
lieves they are sufficiently valid and reli- 
able to be useful. 

_ Bernard (3) has conducted some 
liability studies on the Rosenzweig. 


re- 


Гоп Кїпз (17) and Bell (2) present refer- 


ences to many studies which can be con- 
sidered validation attempts for the 
TAT. Bell (2) summarizes validity re- 
search on the Rorschach. 
_As to the use of these tests, 
tion Opinionnaire was sent out through 
the mail or administered directly to 
Sunday-school classes or other church 
lg On the first contact with po- 
the t subjects the writer administered 
Biol erguson, Wonderlic, and Rosen- 
апа 1n In two instances the Rorschach 
conti AT меге likewise given on first 
Ee but in most cases they were 
c н in two sessions. Adminis- 
-Blesena was standard according to 
Кы i Klopfer's, and Murray's 
only o ions, with the exception that 
Were h the first two cards of the TAT 
Protos he subjects reminded of the time. 
ols were mamually recorded with a 


the Salva- 


relatively efficient mongrel shorthand the 
writer has developed. Tests were given 
privately in any one of three offices or in 
the homes of subjects. 


TABLE 1 
IDENTIFYING INFORMATION ABOUT SuBJECTS 


| Conserva- " 
Item | ms à Liberals 
Number of subjects 
Male 15 15 
Female 15 3 
` | 
Marital status 
Married 27 23 
Single à 3 
Divorced 2 
Widowed 2 
Students 3 4 
Offspring | 48 59 
PROCEDURE 


IV. EXPERIMENTAL 


с A. CONTROL OF NONEXPERIMENTAL 
VARIABLES 
the factors which 


In planning research 
ant to the study 


were considered relev 
were set down, to be controlled if pos- 
sible. These factors with the control 


measures exerted are as follows: 


hite" churches were selected. 
1, geographical). The 
to a higher degree 


1. Касе. Only “W 

2, Background (sectiona 
two cities are cosmopolitan 
than most cities in the country. 

3 Religious tradition (Catholic, Jewish, Pro- 
testant). Protestants only were selected. One per- 
son in each group is of Jewish background. 

4 Socioeconomic status. Since incomes did not 
differ significantly (Table 2), even though oc- 
cupational levels did to an extent, and social 

vere thus minimized (though, of 


class differences v 
course, other factors enter into social class dis- 


tinctions), it seems reasonable to suppose that 
socioeconomic Status would mot significantly 
affect the experimental variables. 

5. Sex. Fifteen persons in each group were 
male and fifteen female. 

6. Position in family. 
perhaps wrongly, that this 
ciently relevant to require control, 
phases of Adlerian dynamics. 

y. Age. An attempt was m 


The writer considered, 
factor is not suffi- 
despite em- 


ade to keep subjects 
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TABLE 2 
COMPARISON OF SUBJECTS ON ІМРОВТАХТ SELECTIVE FACTORS 


Significance 
Item Mean | 5р 1 Level 
| 
Age _ 7 5% 
Conservatives 33-87 | 7.90 2.0 
Liberals 38.63 9-94 | | 
| | 
Education | | | % 
Conservatives 15.37 І 84 2.03 | 5 
Liberals * 16.40 2.03 | 
| 
Occupation* pi 2% 
Орр ЯН 3:23 1.61 2.52 
Liberals | 2.23 I.41 
Family Income^ | m | = 
Conservatives 5.07 Sh {7 | ‚89 
Liberals | 4.37 1.89 | 
Salvation Opinionnaire* | m 
Conservatives 7.84 17 27.33 1% 
Liberals 4.00 74 
Ferguson? R vi 1% 
Conservatives 85.00 7.11 11.86 
Liberals 46.62 15.84 
Wonderlic? ч 2 
Conservatives 30.13 T 5.21 1.02 
Liberals | 31.77 6.89 | 


a Higher mean signifies lower status. 
^ In thousands of dollars. 

e Religious attitude scales. 

3 Intelligence scale. 


between twenty-five and 


sixty, a condition it was 
impossible to fulfi 


ll. The means differ signifi- 
cantly (Table 2), Liberals higher than Conserva- 
lives, Inspection reveals that the trend appears 
to be the same in the populations from which 
subjects were drawn. 

To test whether age did have some influence 
on scores, a simple analysis of variance test was 
run to determine the influence of age and re- 
ligious attitude on Rorschach R scores, Twelve 
cases were selected at random from each group 
for each of the age ranges, twenty to thirty-five 
and thirty-six to fifty. The results shown in 
Table 3 indicate that the influence of age itself 
is not important. The influence of attitude is 

i е F ratio being significant at 
el. But also the interaction of 
is significant at the 5 per cent 
Suspect that both higher chron- 

liberal religious attitude to- 
e's susceptibility to Rorschach 


age and attitude 
level. One would 
Ological age and 
gether increase оп 
stimuli, 

8. Intelligence. Table 2 show. 


5 that the ¢ ratio 
is not significant between the 


group means. 


= 
9. Education. Only high-school graduates i 
those with additional education were ine 
as subjects. Even so, however, there isa poe 
cant difference between group means in ade 
tion (Table 2). An analysis of variance was : a 
to determine the comparative influence O т), 
and education on total Rorschach responses ( 


TABLE 3 3 
7 ; INFLU- 
ANALYSIS ОЕ VARIANCE TO DETERMINE dee 
ENCE OF AGE, Epucation, AND A 
RORSCHACH NUMBER or RESPONSES 


:onifi- 
Factors Involved Degrees ES 
in Total of A 
Variance Freedom 
Age and education 5 & 36 1.62 
Age and attitudes 3 & 44 5.96 1% 
Age only 1 & 44 2.18 1% 
Attitude onlys 1 & 44 9.68 


Interaction of age 


and attitudes | 1& 44 | 6.05 5% 


il. 


igi i i ibera 
* Religious attitude: conservative or li! 


à ‚ SOME 


dividing thé entire sixty subjects into ages twenty 
to thirty-five and thirty-six and above, and using 
educational levels 12-14, 15-16, are 
The F ratio is not significant (Т е 3). One 
may. possibly conclude that of itself he educa- 
tional level did not significantly intluence Ror- 
schach R. i 

10. Student status, A minimum of students 
was thought best in order to have a representa- 
| Pus of the adult population. Three students are 
ound among Conservatives, four among Liberals. 
11. Marital status. This variable would have 
a very difficult to control directly. Reference 
Wee 1 will show that the groups were some- 
comparable on marital status. 
Pus шш background. The original 
election of religious populations and the limita- 
nen of numbers with respect to churches con- 
stituted an attempt to control this variable. In a 
larger sense denominational background means 
carly training as well as present affiliation. It 
Would have been an endless task to assure rep- 

TOesentativeness in this particular. 
| 13. Lay:clerical status. Only lay ре 
selected. | 
Bud Sunday school teacher-n 
med that a teacher might show 


| 


rsons were 


ember. It is as- 
different per- 


| ` 


| sonality trends from a student's though this as- 

i5 sumption is problematical. No attempt was made 
to select with this factor in mind. 

f the ex- 


15. Religious attitudes. This is one О 
perimental variables. There is 50 much variation 
in definitions of “liberal” and “conservative” that 
the selection for this study was made operational 
to the tests mentioned in the first part of Sec- 
tion III. 
16. Church attendance. The groups were not 
equated on this factor, even though it may be an 
important one from an experimental standpoint. 
Almoss no churches keep an actual person-by- 
\ Person record of church (worship) attendance. 

Church relatedness is all that can be postulated. 
Church membership was not considered as à 
ыам, since in most churches it has а rather 
loose correlation with a person's actual relation 


| to the church. 
| Кы Clinical normality-abnormality. АП per- 
| were assumed to be clinically normal, 
ои functioning in society 11 a relatively 
ра way. Three persons in the Liberal group 
had psychiatric (noninstitutional) treatment 


| at some time. 
wu “Emotional maturity.” Maturity as а whole 
n i і to be meas- 
| ured, е of the (multiple) variables to 
| ра Observer's reliability as examiner and 
\ oe This variable was held as constant as 
| -ssible, with the researcher as the one who ad- 


vation Opinion- 


mini 
‘istered all tests except the Sal 
nd TAT’s, and 


Nair 
©, scored both Rorscnachs а 
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made final decisions on the Rosenzweig. 

20. Validity and reliability of tests. As in- 
dicated previously, these factors were assumed to 
be satisfactory. 

21. Form of contact with subjects. One of the 
weakest links in the entire project is the manner 
of contact with prospective subjects. A delay 
forced by circumstances over which the writer 
had no control made contact with populations 
a time when Liberal churches were 
holding group mectings. The result was that 
twenty-five Conservatives were chosen from 
group distribution and five from letter distribu- 
tion, while the numbers among Liberals were 
just reversed. A minute examination of the dif- 
ferences, if any, between group distributed and 
letter distributed may reve 1 some definite trends. 
But the research was continued as if both were 
the same, a. possibly unjustified move. 

22, Volunteers. Respondents to the Salvation 


Opinionnaire were asked to check if they would 


be willing to continue “in this very important 


religious project.” Of the 49o who filled in the 
Opinionnaire 207 marked "Yes." In view of the 
selective nature of this factor, the study might 
be called, "An analysis of those who answer ‘Yes’ 
ionnaires," or simply, ". . . of 


on religious questi 
those who answer religious questionnaires." 
Five of the Liberal subjects did not originally 


“yes” on their returned letters. There 
were not enough Liberals who had checked as- 
sent who also came within the limits set on the 
Opinionnaire. So the writer had to pick at ran- 
dom three persons from the non-"Yes" group 
who did meet requirements; these persons mani- 
fested no hesitation in accepting a part in the 
research. when the situation was explained to 
them. Two other поп-“Үез” subjects were hus- 
bands of women who had consented to partici- 
pate. No striking differences appear to be re- 
vealed between these five persons and the “Yes” 
group on personality measures, except that one 
of the five showed highly neurotic tendencies on 
Rorschach and TAT, including four С on the 
former. ; р 

In the course of the experiment other variables 
came into prominence, chief of which were: 

ag. Acquaintance with examiner. Four of the 
Conservatives selected as subjects were known to 
the researcher from previous contacts; besides 
this he was known to some of the Liberals by 
reputation. It js doubtful that basic personality 
materials could be concealed or more fully re- 
vealed because of the acquaintance. Nevertheless, 
this factor may have exerted some uncontrolled 


influence. 
24. Husband-wif 


impossible at 


answer 


e combinations. Participating 
married couples may have affected each other's 
responses to some indeterminate degree. ТЕ so, 
the influence Was probably balanced, as there 
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were four man-and-wife combinations in the 
Conservative group and three in the Liberal, 
with one couple split between Conservatives and 
Liberals. 


B. SELECTION or SUBJECTS 

Altogether 1035 Opinionnaires were 
distributed; 490 were returned, of which 
twenty-two were defective. By a process 
somewhat similar to sequential analysis, 
representative subjects were selected 
prior to complete returns. The form of 
the first distribution from which subjects 
were selected did not differ significantly 
from that of the final frequency distribu- 
tion when all returns were in. 

Two major divisions were made at 
the mean of the entire original distribu- 
tion, 6.788. Each major division was con- 
sidered to be a distribution in itself, 
overlapping the other to some extent, 
with the lower division mean at 4-951, 
and the upper division mean at 7-799- 
These submeans fall in the modal inter- 
vals for Conservatives (high end of scale) 
and Liberals (low end of scale), 

The two subject groups were then 
selected from within plus and minus one 
probable error of the 
carding alter a brief trial a complex (and 
compulsive) system of limitations of 
ranges of individual scores and numbers 
of questions, the writer adopted a com- 
mon-sense procedure of having prospec- 
tive subjects in each group in rather 
close agreement with one another in 
range and number of scores on their 
Opinionnaires, Where persons had 
checked a larger number than twelve 
(out of twenty-four) Statements, they 


were excluded, as were those with only 
one statement checked. 


Insofar then as the tot. 
ulations" are representative of religious 
liberals and conservatives—and the dis- 
cussion above throws some doubt on 


submeans. Dis- 


al "sample pop- 


their representati ‘eness—the “subsample 
populations” out of which subjects were 
drawn а: “definitely representative of 
liberals aid conservatives. $ 


C. UTILIZATION OF PERSONALITY 
MEASURES 


When protocols of the sixty subjects 
had been obtained by the method out- 
lined previously, scoring was completed 
(so simple it sounds—so many weeks 1t 
took!), and scoring categories which had 
been selected previously from the vari- 
OUS tests and which tend to measure some 
kind of “maturity,” were subjected. to 
analysis, 

On Rosenzweig's test the Group Con- 
formity Rating scores were compared, 
even though Bernard (з) found little 
value in his studies of normals in the 
GCR; for it was assumed that if any 
normaLabnormal differences obtained 
between the groups investigated, the 
GCR would tend to bring them out. pe- 
action-type and direction of aggression 
columns were compared also, as well * 
the special cases of ego-defensiveness, Z 
and Г, which constitute “denials” in Ber" 
nard's terminology. Since not everything 
on the tests could be utilized, "rends 
were not analyzed; but on examination 
these may show significant differences Þe 
tween Liberals and Conservatives: 1 

Beck (1), Klopfer and Kelley (11), vo 
Mons (12) were consulted for Ror 
interpretations, Klopfer's scoring syste" 
was employed with few exceptions: | 
new weighted score was added gru 
did not prove significant with погта >, 
but might with nonnormals), “Sum hé 
comparable to Sum C, to represent : 
"insightanxiety" continuum, as "m 
represents the “controlled responsive? 


ваше 
È s , tint 
“controlled  respunsiveness" СОП 


— ae 


| 


y 
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um. Mons's psychograph (12, p. 92) sug- 
gests that the same kind of relation holds 
among FK, k, and K that Ablg for FC, 
CF, and C (also among M, ray and m), 
With scores closer to the center of the 

° graph indicating more favorable adjust- 
ments. Sum А, therefore, equals FK plus 
2h plus ЗА, all divided by 2. 

For А, Ad, and Aobj, distinctions are 
"made which are not made in Klopfer 
and Kelley (who are not clear at this 
point), Ла was scored as “parts of living 
animals and doubtfully living (usually 
s Aobj was scored as "parts of non- 
living animals." 

The modern movement in refinement 
of content analysis promises to be more 
discerning of personality characteristics 
than some of the more formal analysis. 
" Nevertheless, the writer kept to more 
Widely accepted scores and ratios, except 
for Sum K, and to the more easily quan- 
tifiable aspects of the Rorschach. 

By far the most labor went into proc 
essing TAT protocols. Tomkins (17), 
Murray (1g), апа Stein (15) were re- 
Viewed and found unsuitable for com- 
Plete quantification of data. Therefore, 
an adaptation of the “Thematic Apper- 
ception Test Analysis Guide" (Wesley, 
20) was employed, a system which allows 
for the scoring of smaller units than 
Murray's or Stein’s systems (while at the 
Same time not scoring every word as with 

Omkins), The “Guide” depends in part 
upon Murray’s definitions. 

Guetzkow (9) takes up problems of 
enitizing and categorizing data on quali- 
ating tests. He points out that much of 
ihe interpretation depends on what ped 
the Interpreter selects to score, m » 
the Category sets he employs. As far : 

Present research is concerned, units 


Weve Жыз 
cre fairly well defined by the system, as 
Phrases, a 


sentences, or in some cases 


TES OF 


n 
$ 
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couple of sentences, units which could 
be taken as separate needs, press, inner 
states, or defense mechanisms. Where 
such a unit could not be scored with 
only one factor, that is, it expressed in 
the same words two dynamic trends or 
situations, the scorer did not hesitate to 
use two scoring factors. No attempt was 
made to score for levels (Tomkins), 
though it seems there is no reason why 
quantitative assessment could not be 
made of depth or level. 

Altogether 273 factors were scored, 
some only a few times, but scored never- 
theless. Therefore, separate scores were 
combined into what the writer believed 
to be operational units. These were com- 
binations on theoretical bases, not on 
statistical analysis of separate scores. 

The first 10 cases in each group did 
not receive scores on some of the factors. 
The reason is a purely personal and ex- 
pedient one. At first the writer was scor- 
ing only on the scores which he had de- 
cided were significant to the research. 
But the procedure proved too frustrat- 
ing. For the last forty cases all the scor- 
ing factors in the “Guide” and a few 
others were employed. Less frustration 
and less wasted time resulted from using 
more rather than fewer factors. 

Since the change from scoring some to 
scoring all the factors also made a differ- 
ence when transforming raw category 
scores into percentage scores (which were 
utilized for comparisons), when signifi- 
cance tests were run, tests for both thirty 
cases apiece and the last twenty cases 
apiece were made. It was assumed, how- 
ever, that since omissions occurred in 
ten cases in each group, any discrepancy 
caused by the change would tend to bal- 
ance itself out. In all cases except one, 
that designated Column 9,1 n Dep, —n 


1 Defined below. 
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Dep (1), the assumption was borne out: 
in this case, the only seemingly unequiy- 
ocal difference between the two groups 
of thirty cases apiece disappeared when 
twenty cases were compared. 

Out of 49 combined-factor categories 
to which individual scores were assigned 
only 19 were compared, since the others 
did not yield enough scores to make sig- 
nificance tests. For the definitions of the 
individual scores comprising a category, 
reference will have to be made to the 
"Guide" already mentioned (Wesley, 20). 
But the combined categories are roughly 
characterized by the statements below: 
the reader may be able to follow the 
meanings of scoring symbols to some ex- 
tent by comparing them with summaries. 
The scores were originally set up in 
columns, hence are referred to as “Col- 
umns” below. 


Column 1: References to the external world, 
physical and mental capabilities, and opportuni- 
ties in general, beneficial to hero. (p Env, р Good, 
Р Ment, p Oppor, р Phy) 

Column 2: Bad health, bad fortune, lack of op- 
portunities, danger, or trouble in general, di- 
rected toward hero, (b Afflic, р Bad, b Dang, p 
Troub, —p Env, —p Oppor) 

Column 3: Hero's feelings and attitudes ones of 
security, certainty, adequacy, calm, lack of tur- 
moil and anxiety, (Adeq, —4пх, —Conf, —Confi, 
Cert, —Dist) 

Column 4: Hero’s feelings and attitudes ones of 
uncertainty, insecurity, inadequacy, turmoil and 
anxiety. (—Adeq, Anx, Conf, Confl, —Cert, Dist) 
Column 5: Hero’s self-blame, or failure to blame 
self. (n Agg (I), —n Age (1) 

Column 6: Hero's attacks on others, verbal or 
physical, including deception and rejection. (n 
Agg, n Age (Р), n Decep, n Rej) 

Column 7: Hero's resistance to authority, or show 
of independence rather than dependence, (—n 
Compl, —n Dep, n Dep (I), п Resis, —n Subm) 


in or depend on self. (n Dep, —n Dep (1)) 

Column 10: Hero's desire for Or success in gain- 
ing freedom. (n Free, p Suc-Free) 
Column 11: Hero's sympathy with, protection of 
or help directed toward another. (n Emp,n Help) 
Column 12: Hero's failure to show Sympathy, give 


protection to, or help another. (—4 Emp. —n 
Help) Column 13: Defense mechanisms employed 
either by subject or hero, or hero's defense of 
self. (Def |. tech, n Just) 

Column r^. Others’ acceptance of, dependence 
on, affection for, or failure to reject or aggress 
against hero. (—p Age, —p Agg (P), p Affec, =p 
Decep, p Dep, p Affil, —p Rej) е 
Column 15: Others’ aggression against, rejection 
of, lack of dependence on, or failure to show 
affection for hero. (p Agg, p Agg (P).—p Allec, P 
Decep, —p Dep, —p Affil, p Rej) 

Column 16: Others restraint of or dominance 
over hero. (p Coerc, p Dom, p Pers, p Proh, p 
Restr) В 
Column 17: Others’ sympathy with, protection 
of, or help directed toward hero. (p Етр,.р Help) 
Column 18: Failure of others to slow sympathy 
with, give protection to, or help hero. (—p Emp: 
—p Help) A 
Column 19: Hero's striving for or success in 
achieving higher goals, moncy, education, О! 
knowledge. (n Ach, n Acq, p Suc-Ach, p Suc-acq, 
p Suc-Cog) ‘ 


A number of individual scores on each 
test were specifically hypothesized hs 
relation to various levels of maturity. 
Others were not. Only those which were 
hypothesized beforehand were allowed 


: y à See - 
to influence conclusions directly. (se 


Section VI.) 


V. QUANTITATIVE METHODS 
AND PROCEDURES 


In reducing qualitative data to qua! 
tities some of the original quality ів lost 
Nevertheless, when the purpose is ко 
parison of groups, quantitative compan 
sons are really the only accurate kin Я 
that can be made, for qualitative о. 
parisons are too much subject to Ew 
vidual biases, too much influenced ы 
the very individuals who should be pe 
tially disregarded in comparing gtoUP* 
namely the individuals in the tails ° 
the distributions. meulties 

Cronbach (4, 5) summarizes difficu lti 
in making tests of significance on Lec Г 
Score tests, For the Rorschach specifica T 
he recommends raising the P value 


= 


rea 
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1 s see 
Rongscuacu M:SUM C ADJUSTMENT SCALE FOR HIGH AVERAGE INTELLIGENCE ADULTS 


Ranks | x ма i 
jb b Ratios 
7 | | : |423 | 574 | 623 | 726 | 8:7 | 9:8. | того 
| | 3:4 425 5:6 26:7 [7:8 8:9 9:1o | 10:8 
| | | к | 826 [1] 
в : a [ese | Е 
Д | 1323 | 4:4. |525 6:6 | 8:8 10:10 
| 2* Y 5: : : 
| 3:4 | 4:2 5:3 | 6:4 | 8:10 10:7 
Я | | | 
5 | | 3:5 4:6 5:7 6:8 8:5 то:б 
| | | 
| | 
4 1d 2:4 зїт |4:7 | 538 6:3 | 7:3 |8:4 | 9:4. | 10:5 
1:3 2:0 | 3:6 4:8 5:2 6:2 7:10 9:5 
1:2 | «її 6:10 
| 6:0 
3 | о: 114 E 4:0 5:10 | бїт 7:2 8:2 9:2 10:3 
‹ | о:2 1:0 4:9 $:1 6:0 2u 8:3 10:4 
| 1:5 4110 | 5:0 7:0 
| | Sed 
5 6:3 1:6 26 3:10 8:0 | 9:1 10:2 
Phi 1:7 " 81. °: Tot 
о:5 1:8 2: 10:0 
0:6 
© 
1 0:7 1:9 2:104- | ITSO, 
9 о:8 riro- 
0:9 
o:104- | | 
accompanying text for principles of construction. 


“High rank signifies high adjustment. See 


quired for significance as the number of 
Comparisons is increased. This sugges- 
tion was not adopted directly in the 
Present research, but was kept, as it were, 
a background. If P is raised to .001 
st her than the usual .o1 or less exacting 
"andard, only two of the significance 
жс оп personality measures in this 
R у reach significance, $ proportion to 
of rs the Rorschach, and TAT Length 
stories. (CE. Table 7) 
other ore investigating thoroughly what 
on : had done in making comparisons 
multiscore tests, the writer had 
ne his statistics so that raw scores 
Score be transformed into percentage 
5 or proportions for comparisons. 
€ reasoned that if Rorschach A's dif- 
“ted significantly (as they did differ in 


his data, it turned out), any further com- 
parison of raw scores would merely be a 
function of the total responsiveness of 
the two groups. 

On the Rosenzweig, raw scores are 
transformed immediately into percent 
ages; but these both mean the same any- 
for there can be just twenty-four 


way, 
except in the rare case of 


total scores, 


unscorable responses. 
It was felt that the same argument 


would hold for the TAT as for Ror- 
schach; therefore, percentages or propor- 
tions were compared. 

Small denominators in ratios may be 
unreliable, so Adjustment Scales were 
constructed (see Tables 4 and 5, eg.) 
which did not depend on working out 
fractions, Ratios were transformed into 
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TABLE 5 > 
RORSCHACH ЕС:СЕ-ЕС ADJUSTMENT SCALE FOR HIGH AVERAGE INTELLIGENCE AUIS _ » 
= T 
: fec 
Ranks Ratios ^ _ " 
zs 4 — m x 
| o 
5 i 9:0 10 
7 | 
! ey 
6 1:0 536: | 6:6 | si Sir 9:1 uiid 
n б:1 9%% M 
| жей 
: z ИР š 3 | 10:3 
3 1:0 2:0 3:0 4:1 Six 6:2 7 8:2 9*3 е 
4 III 2:1 4:2 7: 
2:2 FS 7 
213 414 7 | 
| 4:3 7 | 
| | 7 
| |7: | 
3 1:3 2:4 gx |46 7:0 по | | 
1:3 2:5 | 3:0 4:7 7:10 | 
2:6 | 3:7 | | * 
2 о: | 1:4 || 28s 3:8 4:8 | 
0:2 1:5 2:8 4:9 | 
| o:3 1:6 | | 
| 
1 | ong | ru 2:o+ | 3:0+ | 4:то+ | 
оо | | 
3 High rank signifies high adjustment. See accompanying text for principles of construction. 


fractions only for making intragroup 
comparisons of rank orders on the two 
introversive-extratensive ratios yielded 
by the Rorschach, M : Sum С and (FM + 
m) : (Fc + c + C^). 

In working out the M : Sum C and FC : 
CF+C Adjustment Scales (Tables 4 
and 5), ratios which were equal numeri- 
cally were considered in part as equal 
psychologically, contrary to a warning 

' by Cronbach. An examination of the 
M : Sum С Scale (Table 4) reveals this 
fact patently in Rank 6 where ratios 
from 3:9 to 10:10 are grouped together. 
Whatever the meaning psychologically, 
however, the distributions on these two 
scales in both subject groups turned out 
to be fairly normal, though platykurtic. 

Analysis of variance was discarded for 
comparisons because, in part, the experi- 
mental design was not planned as an 


analysis-of-varianee experiment, but also 


ww 


because the data cannot be handled by 
analysis of variance. The many scores 
on each test cannot be considered яз 
different scores from different individ- 
uals, or even as different scores from the 
same individuals on the same test, but 
as different (though related) scores ОП 
different (though related) tests. f 

After consideration of other tests ° 
significance and consultation with st@ 
tistical authorities, simple ¢ tests were 
chosen to make comparisons between the 
two groups of persons. И 

With the Rosenzweig, since the same 
number of total responses is found 17 
all cases, there is probability of correla- 
tions among percentage columns; hence 
correlation coefficients were obtained be 
tween the Obstacle-Dominance, Ego-D€ 
fensive, and Need-Persistence columns 
for Conservatives, The O-D column 1$ 
"Ot significantly correlated with the 


ч 


others. But the E-D and N-P columns 
correlated with an r of —.65, which is 
significant at the 1 per с pvel. 

The comparison of ED 33d E 4 1 
means oi the two groups showed a sig- 
nificant 1 ratio (2 per cent level). Since 
E+! is a combination of scores taken 
Out of the E and Z scores, and specifically 
from the E-D column, the writer was not 
sure how to handle this combination set 

3 of scores, He decided that if there was 
Not a significant correlation between E-D 
and E + I, no dependent relation would 
be shown, and a t test could be safely in- 
terpreted for E + Z. As it is, however, 
the coefficient of correlation, .40, is sig- 
Pificant at the 5 per cent level. So in 


the final analysis the E + Z comparison 
_ Was discarded. 
A question may be asked here (or any- 
Where), "Are the distributions of per- 
centage scores on the various tests rela- 
tively normal?" The answer is, "Yes, for 
the most part." In only a few ca 
distributions were skewed consid 
But both Conservatives and Liberals had 


skewed columns, and in the same direc- 
lly normal 


ses the 
erably. 


tion. On the basis of practica 
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distribution of means of skewed dis- 
tributions like these, it was decided that 
t tests could. be utilized when skewness 
was practically the same in both curves 
to be compared. 

A number of columns of both TAT 
and Rorschach scores contained too few 
scores to constitute à distribution in 
which ¢ could be used on percentages 
of R. Therefore, when the scores that 
were present were scattered among a 
number of individuals and no one indi- 
vidual contributed an undue weight to 
the proportion, proportions of group 
scores to total responses were compared. 
The hypothesis to be tested was: The 
sum of Conservative or Liberal scores on 
each variable is in the same proportion 
to the combined Conservative and Lib- 
eral scores on that variable as the total 
number of responses of Conservatives 
or Liberals on the entire test is to the 
combined responses of both groups on 
the test. If the proportions differed sig- 
nificantly, the hypothesis was rejected. 

Besides the foregoing, one minor com- 
parison was made, that between rank- 
order correlation coefficients on the two 


TABLE 6 


BETWEEN TESTS AND WITHIN TE 


SIGNIFICANT CORRELATIONS SHowING RELATIONS 
б = df — MÀ Significance + 
Test or Factor Leser 
—— 
Salvation Opinionnaire and Ferguson 38 +73 1% 
| (Subjects and eliminees)” 
Salvation Opinionnaire and Ferguson 28 77 1% 
(Subjects only)” 
| Rosenzweig E-D and N-P 28 = +85 1% 
| (Conservatives only)” 
Ros je 
| enzweig E-D and E--T 28 до 5% 
| (Conservatives only) 
r 
| Rorschach (3: Sum C) and (км+т:Ес+е+С) 28 39 5% 
| onservatives only)* ^ 
5. Р Refers, of course, only to probability level, not degree of association. 
> , only А 
Pearson product-inoment 7. " Introversive-Extratensive ratios. 


e " 
| ank-order correlation between tw 
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introversive-extratensive ratios men- 
tioned previously. The question to be 
answered was whether or not there was 
any higher correlation between these two 
supposed measures of introversion-extra- 
tensiveness in one group than in the 
other. The coefficients were transformed 
into Fisher's z function in order to utilize 
а t test, which depends on the assump- 
tion of a normal distribution of sam- 
pling means or other statistics to be com- 
pared. It can be seen from Table 6 that 
the true correlation for Conservatives 
may be significant. That for Liberals 
was not significant; but a £ test revealed 
no significant difference between the 
Conservative and Liberal coefficients. 

Several original adjustment and bal. 
ance scales were constructed in order 
to make further comparisons which can- 
not be made in simple percentages and 
proportions. These made use of Ror- 
Schach raw scores in their respective 
ratios. The first of these scales simply 
listed M : Sum С ratios as introversive, 
extratensive, or "no trend" on the basis 
of Rorschach theory, Even though addi- 
tional M, FM, and m Were not included, 
as Klopfer (11, Р. 253) suggests they 
might be, both §roups were very much 
overweighted in the introversive direc- 
tion, Conservatives' frequencies being 22 
Introversive, 1 “no trend," and 7 extra- 
tensive, and Liberals frequencies 24, 5, 
and 1 respectively. 

The other ratio indicating supposedly a 
person's Erlebnistyp, (FM + т): (Fe + c 
+ C^) yielded the same results as M : Sum 
C. Conservatives" ratios scored 24 intro- 
versive, 1 "no trend," and 5 extratensive, 
and Liberals’ 23, 2, and 5 respectively, If 
the two groups of this study manifesting 
such strong introversial trends on the LE 
ratios are at all representative of the 
population at large, questions may be 


asked either about the adequacy of the 
ratios or the usual assumptions about the 
distributie 6r introversion and extra- 
tensivenes — |! 

In conjunction with the above indi- 
cators of Erlebnistyp, the third major in- 
dicator suggested by Klopfer, the per- 
centage of responses to the last three 
cards came the closest to theoretical ex- 
pectations. Conservatives averaged 41.32 
per cent with a standard deviation of 
11.55; Liberals averaged 39.28 per cent, 
standard deviation 11.05. 

M :Sum C ratios were compared for the 
two groups by means of frequency dis- 
tributions оп the Adjustment Scale 
represented in Table 4. Prior to exam!- 
nation of the data from subjects studied, 
ratios within reasonable limits of M : Sum 
C were grouped into seven classes on the 
basis of the following principles. 


1. A slight unbalance either way represents i 
more favorable adjustment than an exact ha 
ance, 


2. A greater unbalance of Sum C, in the smaller 


5 i : " 
ratios especially, means a poorer adjustment that 
the same for M. 


3. The quality of M and the presence of С are 
disregarded. 

4. For above-average intelligence adults, at 
least three M’s should be produced for best ad- 
justment. 

5. Where a ratio has a fraction, .5, the figure 
is raised to the next higher whole number for 
matching to the Scale, 


Whether the Scale has any psychologr 
cal meaning is one question; whether on 
two distributions of ratios it appears to 
hypothetically correct, the question 15 
answered affirmatively. A chi-square tear 
of the hypothesis of normal distribution 
(Guilford, 10, p. 284f.) produced a chi 
Square for Conservatives of .98. The ends 
of the theoretical and observed distribu- 
tions were combined, making only vn 
Sets of discrepancies, but the number hs 
degrees of freedom was judged to be fou! 


(seven class intervals). Even if there were 
only one degree of freedom, however, 
:98 would not be significantgOther chi 
Squares were not worked out i Liberals 
or for either group on the other Adjust- 
ment Scale below, since the forms of 
their distributions approximated the one 
already tested. 

Table 5 presents the ratios of FC : CF 
+ С divided into seven classes, a set of 
rankings set up before the data from the 
research groups was examined. This 
Scale is not quite so successful from the 
Standpoint of approximating normality 
as Ше M : Sum C Adjustment Scale. It 
May, however, represent more psycho- 
logical meaning than the other, since the 
Upper levels of optimal adjustment in- 
clude fewer persons than on the M : Sum 
C Scale. The principles of construction 
of the scale are the following. 

Pio ранее, toward FC is considered more 
$ able to adjustment. 

2. óPhe presence of С per se is disregarded. 

. Besides the above Scales, several Ad- 
Justment Dichotomies were constructed 
for comparison purposes. An (FM + m): 
(FC + c C^) Balance Adjustment Di- 
chotomy was worked out on the follow- 
ng simple principles. 

1. The more evenly balanced ratios are те- 


FE as more favorable to adjustment (3:2, 2:3, 


ae The absence of one or the othe 
the ratio is not considered unbalanced if the ratio 
15 small, 


r member of 


Apparently, this balance scale is satis- 
actory theoretically, for both groups 
Produced a large majority of “balanced” 
individuals, 23 to 7 in each group; meet- 
ing expectations in a relatively normal 
Population. 

The two other dichotomies worked out 
lo-make comparisons between the groups 
Were Dot so satisfactory from a statistical 
Standpoint. A py: M Balance was con 
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structed on the following principles. 


1. At least a 2:1, and better, а 3:1 ratio is held 


necessary for balance. 
2. At least three M's are considered necessary 


for balance. 

The ratios divided the Conservatives 
into sixteen “balanced” and fourteen 
“unbalanced” persons and the Liberals 
into nineteen “balanced” and eleven 
“unbalanced.” Additional factors such as 
the quality of IV and M may be needed 
to make this Balance scale more mean- 
ingful. 

A similar criticism of the statistical 
value of the М: FM + m Balance can be 
made. This is a dichotomy in which 
ratios are divided into balanced and un- 
balanced according to the principles be- 
low. 


1. At least two M’s and a ratio of 1:1 or at the 


most 2:3 are held necessary for good balance. 
2. A preponderance of M is more indicative 


of adjustment than one of FM--m. 
3. When larger numbers of М and FM--m are 
produced, an unbalance in favor of FM+-m is 


not destructive of balance. 
4. The presence of larger amounts of m com- 


pared to FM has not been regarded in making 
divisions. 

5. The quality of the responses is disregarded. 

The actual divisions into "balanced" 
and “unbalanced” ratios happened to be 
exactly the same as with the W : M scale, 
sixteen and fourteen for Conservatives, 
and nineteen and eleven for Liberals. 

"Gestalt limits" presented by both 
Klopfer and Mons for W : D: d: Dd + $ 
were supposed to be indicated by ranks 
ranging from 1 to 4, the latter represent- 
ing the best adjustment, with an indi- 
vidual assigned a rank depending on 
how close he fell within the limits set 
forth in Klopfer's “Manner of Ap- 
proach." It was found that no ome in 
either group fell exactly inside the limits, 
and most persons fell far outside. Again, 
either the two groups are entirely apart 
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from the average or normal, or new 
norms are needed. The writer believes 
from other experience as well as this that 
serious questions can be raised about 
these so-called “gestalt limits.” 

The various scales which have been de- 
scribed are offered not only as the means 
by which the data of this research were 
ordered in part, but also as simpler 
models of what seems possible on a more 


7. (The last line of the table is a variant 
of the ninth.) In order to evaluate the 
summary ;^zorrectly two facts must be 
kept in vi w. First, at the 5 per cent level 
of significance one would expect two oF 
three out of 52 t tests to be significant 
just by chance. And secondly, 43 out of 
52 tests were not significant. 

Relating the quantitative results to 
the hypotheses set up to guide research, 


TABLE 7 


SUMMARY OF SIGNIFICANT DIFFERFNCES BETWEEN T 


ELIGIOUS CONSERVATIVES AND 


LIBERALS ON PERSONALITY TESTS 


Group having higher г 
Tiest Factor | Mean Score, Mean i Significance 
ок | Percentage, or Level 
Proportion | 

Rosenzweig E-D% Conservatives 2.45 | 2% 
Rosenzweig E+1% Conservatives 2.64 | 2% 
Rorschach А Liberals | 2.92 1%" 
Rorschach F+:R Liberals | 2.58 2% 
Rorschach FK:R Liberals 2.14 570 
Rorschach S:R Liherals | 4.13 | 1/0 
Rorschach P% Conservatives 2.77 140 
TAT Length of Stories Liberals | 5.28 1% 
n Dep, -n Dep (I)®% | Conservatives | 2.64 2% 
TAT n Dep, -n Dep (I):R | Conservatives 2.01 540 


а 2% with Adjusted Liberal mean. 

b This refers to Column 9 defined in text. 
complex plane. Rorschach experts have 
much to say about configurations and 
interaction of one score with others. But 
it seems that by grouping scores to- 
gether that appear to go together and 
examining large numbers of normal 
records an empirical set of scales could 
be derived that would not depend only 
on how many different factors an intelli- 
gent interpreter can keep in mind. 


VI. CONCLUSIONS 


A. QUANTITATIVE. COMPARISONS 
Out of 52 t ratios computed, nine sig- 
nificant differences were found between 
percentage means, proportions, and two 
of the raw scores which were compared 
(Rorschach R and TAT Length of 
Stories). These are summarized in Table 


one finds that the majority of the hy- 
potheses must be rejected. 

Hypothesis 1. Religious liberals are 
more “emotionally mature” than reli- 
gious conservatives. Considering “етот 
tional maturity” as а summation of in- 
dividual aspects of "maturity" repre 
sented by scores on the personality test: 
it was concluded that this hypothesis had 
to be rejected, or accepted only as appli 
cable to limited areas. Four of the nine 
scores (Table 7), E-D, F+, FK, and 5, 
were specifically hypothesized as testing 
maturity. The first three are in the direc 
tion of the hypothesis. Therefore, "i 
might be said that in the areas of ре” 
ceptual keenness and insight Liberals ap 
pear to be more fully-leveloped (mature) 
than Conservatives. If the E-D t rave 


can be trusted, Liberals also tend to be 
less ego-defensive. 

The other scores in Tablegy were not 
specifically set up for testing Hypothesis 
1. It is not accepted scientific practice to 
base conclusions ad hoc on comparisons 
made after the data are inspected 
(though the principle is not observed 
in many instances). Therefore, these dil- 
ferences can be used as suggestive hy- 
potheses for future research, but not di- 
rectly as means of proof or disproof of 
the present proposition. 

Alter ail the significant differences are 
reviewed, however, and even if all of 
them should be admitted (if p should be 
Set at .oo1 for significance, only two 
could be admitted), the fact stated above 
must be remembered: that on 42 other 
Scores, most of which, if not all of which, 
are presumably independent, there are 
No significant differences. The majority 
Of these 42 were specifically hypothesized 
in Connection with the "emotional ma- 
turity” hypothesis, so must be held to be 
germane to its acceptance or rejection. 

Hypothesis 2. Rigidity of personality 
Structure and conservative religious atti- 
tudes are positively correlated. If Rosen- 
Zweig E-D and Е +7 were in columns 
uncorrelated with each other oF with 
this second proposition 


other 
ther columns, 
e Con- 


а-ны be accepted іп part, sinc 
atives could be shown to possess conr 
Paratively greater defensiveness or rigid- 
ity as measured on the Rosenzweig. But 
= correlations were found between 
"-D and other columns, linear relations 
in hien significance tests depend) most 
ars y do not hold; therefore, the t inel 
Widen e The one major score On 
po; h a difference was expected to occur, 
ыи the Rorschach, did not show 
cant mean differences. 
qu pes 9 D:fferent types of emo: 
control are found in both groups: 
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It was anticipated that the Rorschach in 
particular would show that the Con- 
servatives employ more intellectualized, 
formal types of control, while Liberals 
employ more emotional, inner types of 
control. The fact is, as tested by this 
study, no significant differences appear 
between the groups. Therefore, this hy- 
pothesis is rejected. 

Hypothesis 4. Conservative individuals 
are more guilt-ridden than liberals. It 
was specifically stated prior to making 
comparisons that Conservatives would 
show higher indices in reference to guilt 
than Liberals on Rosenzweig E-D, TAT 
n Agg (I) and Guilt, and in corollary 
fashion would show more inadequacy 


and insecurity feelings as measured by 


TAT Adeq and Anx (and their nega- 
tives). Since the t ratio on the first score 
has possibly an ambiguous meaning, and 
попе of the other t ratios approaches sig- 
nificance, Hypothesis 4 is not accepted. 

Hypothesis 5. Liberals tend to gloss 
over aggression-provoking situations 
than conservatives. М 
implying impunitive reac- 
ought above 


more on the 


Rosenzweig, 
tions to aggression, Was th 
other scores to tend to measure a eglossing 
ovoking situations in 
connection with this hypothesis. No real 
difference obtains between the two 
groups according to this test, so the hy- 
pothesis is rejected. 

Hypothesis 6. A greater need for de- 
found in the conservative. 
proposition among six 
though with reserva- 
f the TAT, including 
Dep (I) has been 
hat suspect, in that 


over of aggression-pr 


pendence is 
This is the one 
which is accepted, 
tions. Column 9 О 
scores п Dep, =” 
shown to be somew 
on twenty cases apiece (the group in 
which the effects of possible scoring 
errors are removed), the significant í 
ratio disappears. It is not certain, how- 


ever, that scoring errors are responsible. 
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In no other comparison of twenty cases 
apiece were the t-test results obtained on 
thirty cases changed. There is in Column 
9 an overweighting of scores in the first 
ten cases among Conservatives. This con- 
dition could arise from scoring errors; 
but since in no other case did such over- 
weighting occur from scoring errors, it 
seems reasonable to believe that the 
higher TAT scores (Column 9) in the 
first ten cases reflect the actual condition. 
So when they were eliminated, the other 
twenty scores did not truly represent the 
total distribution of Conservatives. 

Also hypothesized, as a negative in- 
stance, was the Rorschach score S. AI. 
though it has other meanings, it is a 
sign of independence. The 1 per cent 
level of significance (in fact, the .oo1 
level) favors Liberals in independence. 

A further consideration that cannot be 
disregarded is the difference betwee: 
P% means (1 per cent level). Although 
this score was not specifically hypothe- 
sized for the dependence-independence 
continuum, the fact that a real difference 
of means exists between the groups on 
P% adds no reason to reject the hy. 
pothesis. 

On the Opposite side of the ledger is 
Rorschach 4%. It was strongly suspected 
that Conservatives would be much 
higher in this category. The fact that the 
obtained ¢ ratio could easily occur by 
chance tends to militate against the ac- 
ceptance of Hypothesis 6, 5 


The writer must admit that the hy- 
potheses he set up originally are not all 
clear-cut and admissible of unequivocal 
answers, as good hypotheses should be. 
They seemed to be Satisfactory when 
first proposed, but the research showed 
how “fuzzy” several of them are. Future 


research along this line will have to 


Propound more, single-minded hy- 
potheses. 
B. QU aurrative COMPARISONS 


When the two groups under study are 
compared qualitatively, the same results 
approximately are yielded as in the 
quantitative comparisons. At the conclu- 
sion of testing all subjects, the writer 
had only one clearly defined opinion, 
that wide differences existed among 1n- 
dividuals in the groups; but he had no 
idea whether these differences repre- 
sented groups as such. In processing те- 
Sults the scores were so many and the 
scoring so complicated that it was im- 
possible to tell at any time which group 
had more "balanced" scores. This in- 
ability to tell which way balance lay con- 
tinued up to the very last comparison of 
all significance tests. " 

If further treatment of the writer's 
data or other f uture research with more 
refined methods should yield different 
conclusions, the writer would not deny 
that. more adequate methods can pro- 
duce different results. He feels that 
though his study has its values, it also 
has limitations. 

The major qualification to be kept 
in mind in interpreting results is that 
only 490 out of 1035 persons returned 
the Salvation Opinionnaire, Such a situa- 
tion introduces a selective factor which 
mày make for nontypica] samples. TH 
response factor operated to a greater C 
tent among Liberals than among Cor- 
servatives, for twenty-five out of thirty 
Liberals were selected from letter-dis- 
tributed returns and only five out of 
thirty Conservatives were so selected. 
Group distribution yielded virtually iod 
Рег cent returns, so the selective facto! 
under consideration did not affect Con- 
Servativés to an appreciable degree. 


SOME 


One mitigating circumstance may in- 
dicate that the Liberal sample is repre- 
sentative of religious Liberals as a whole. 
Wonderlic (intelligence) score{{revealed 
that Liberals were more intelligent than 
Conservatives (1 per cent level), when 
Comparisons were made involving both 
subjects and eliminees (those with scores 
below ?0 on the Wonderlic or incon- 
Sistent scores on the two religious tests). 
This finding is in keeping with previous 
research. 

, In the meantime it may be stated that 
if these samples are representative of 
their respective religious populations, 
and if the tests actually measure what 
they are supposed to measure, and if the 
Writer's reliability as examiner and scorer 
15 sufficient, the religious populations 
designated as “Liberal” and "Conserva- 
tive” appear to be one in matters of per- 
Sonality and of maturity, with only one 
admissible exception found in this study, 
that of greater dependency among con- 
Servatives, 


УП. SUMMARY 


1. The Salvation Opinionnaire (19) 
Was sent to or administered directly to 
1035 persons, of whom 490 returned the 
Opinionnaire and information sheet. 

3. Sixty persons (3o persons in each 
Sroupj were chosen whose scores on the 
- P!nionnaire and Ferguson's Primary 
Social Attitude No. 1 (Religionism) in- 
bad, representaivenes of Ens 

or conservatism, and whos 
Wonderlic Personnel Test (intelligence) 
Scores were 20 or above. Other means 
ОЁ selection were employed to assure 
Comparability on nonexperimental fac- 
tors, 
$ 3. Rosenzweig's Picture-Frustration 
Эду, the Rorschach, and the Thematic 
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Apperception Test were administered to 
the sixty subjects. 

4. Selected variables relating to “emo- 
tional maturity” were compared by 
means of ¢ tests of percentage, propor- 
tion, or ratio-frequency scores. 

5. It was found that nine out of fifty- 
two significance tests showed statistically 
significant or very significant differences 
between means or proportions. 

6. On the whole it was found that the 
two religious-attitude groups could be 
considered samples from the same popu- 
lation as regards personality factors, with 
the likely exception of dependency feel- 
ings in which a greater need is shown 
by the religious conservatives. 

No specific meaning has been attached 
to the greater Liberal responsiveness on 
the Rorschach and TAT, since there 
seems to be no agreement on specific 
significance of the amount of respon- 
siveness, except for pathological rejec- 
tions and consequent constriction of rec- 
ords. Р 

What meaning, in terms of explana- 
tion, greater dependency on the part of 
Conservatives has can only be conjec- 
tured at this time. It may mean, on the 
analogy of the experience of others who 
have been investigated in this area of 
dependence, that such dependence has 
been fostered from early childhood. Or 
it may mean that the type of religious 
training which Conservatives have re- 
ceived tends to promote feelings of de- 
pendence. Of course, some combination 
of these two aspects may be the actual 
situation. The writer is inclined to be- 
lieve it is more probable that those with 
similar types of dependency needs, aris- 
ing out of infancy and early childhood 
training, would band together for mu- 


tual support. 


ГУ 


e 
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PERSONAL SECURITY AS RELATED TO STATION IN LIFE? 
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I INTRODUCTION 


Alpe concept of personal security is 
Bits "рн employed by social scien- 
Since ut many of those who find the 
the pt useful are not clear as to what 
ie oe by the term. What some 
h e refer to as security or insecurity 
Rein by others as adjustment or 
the gg high or low morale, and 
stud : е. The general purpose of this 

У was to investigate the nature of 
on security to determine what it 
bonu! DA owe and to gain some 
curit s about correlates of personal se- 

у. This involved several steps: 
Nera investigation was made of the 
cept = and usages given to the con- 
ооо], personal security by many psy- 

gists and other social scientists who 
ie = ona this concept in recent 
temati N spite of wide variation in sys- 
follow, treatment and terminology, the 
ou ing nucleus of agreement was 

nd: 


amic" concept. Peo- 


Pe. 

TSi : 

onal security is a “dyn 
areas O 


е se u ‹ 
ek security within their various 
1 
Th ый : 
Paper € opinions or assertions containe 
соль ате those of the author and аге n 
the FS as official or as reflecting the V 
«S. Publ; s 
+ Public Health Service. 


d in this 
ot to be 
iews of 


striving: by achieving it, they become secure in 
some areas; by failing to achieve it, they become 
insecure in other areas. The areas of personal 
striving are interrelated and overlapping, and 
some may be of greater importance than others 
to the security of the individual. Feelings of 
security or insecurity may tend to become gen- 
eralized throughout the personality structure, or 
they may be projected from one area of striving 
into others. Furthermore, the biological structure 

al environment of an indi- 


or physical or soci 

vidual, by limiting or influencing the character 
and direction of his motivations, may have a 
t bearing upon the nature of his securities. 
ons or possibilities, there 
el or status of security, 
within the individual 


direc 
In view of these conditi 
appears to be a general lev 
as well as levels of security 


areas of striving. 
A person's feelings of security or insecurity 


within any area of striving involve his own sub- 
jective evaluation of his success, satisfaction, and 
surety or confidence with respect to the carrying 
out of his purposes in past and present situations 
and group relationships, also, his expectations, 
hopes, fears, or uncertainties with respect to the 
carrying out of his purposes and aspirations in 
future situations and group relationships. 

Feelings of security within any functional area 
vary on a continuum, 50 that security status with- 
in any area of striving or within any situation 
may be considered a matter of degree rather than 
a matter of absolute. 


2. The next objective of the present 
investigation was to develop a question- 
naire based upon this concept of per- 
sonal security, and to administer this 
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questionnaire to groups that are osten- 
sibly secure and to those who have been 
classified by psychiatrists as "insecure." 
This was intended to provide a test of 
the validity of the concept. 

3. It was then planned to administer 
the validated personal-security question- 
naire to a sample of adults varying in 
income and occupation for the purpose 
of comparing the security of different in- 
come and occupational groups. This was 


KNUTSON 


designed to test the thesis that other- 
wise normal persons who lack economic 
security tnd to feel insecure in the more 
developniental areas of striving, such as 
belongingness, sex, personal appearance, 
cultural activities, etc. It would also test 
the hypothesis that patterns of security 
vary within a population according 10 
income, occupation, education, etc.— 


what might be termed their station in 
life. 


—_— 


"n 


П. METHOD 


I" was decided to investiga security 
feelings by means of a qu ionnaire 
that could be used in a group situation 
as a pencil and paper test, or, with some 
variation, in a directinterview situation 
аз а public opinion schedule. The ques- 
tions were selected with an eye to satis- 
lying the criteria of opinion research. 


Many of the limitations of paper and pencil 
tests of personality have been pointed out in the 
literature, and these draw attention to the need 
for interpreting with caution апа reservation 
findings based on such methods. It has been 
emphasized that individuals may not know or 
Understand. what motivates them, and that for 
this. reason we may never be able to get at basic 
Motives by asking questions. Adequate alterna- 
lives to fixed questions may not be offered be- 
Cause they may not even be known. When inti- 
Mate or emotional matters are touched upon, 
blocking may occur. Conscious and subconscious 
cheating is likely to occur when the ego is in- 
Volved, etc, i 

These limitations, common to all pe 
Questiónnaires, have been recognized, bu 
9f the subjective nature of security feelings, no 
alternative to questioning as a means of studying 
Security seems possible. Truman Kelley has 
Pointed out, “If facts of a unique nature, known 
90у ito specific individuals, are desired, then an 
oral or written questionnaire addressed to the 
Persons knowing these facts is the only possible 


method of approach” (8, р. 35). 


sonality 
tin view 


i In developing our questionnaire, a se- 
Cctiow was first made of certain major 
areas of striving within which people 
May be secure or insecure. Then a rank- 
ne method was developed for obtaining 
^ rough grouping of these areas in term 
of their importance to individuals. Fi- 
nally, a questionnaire was designed to 
Бес at personal feelings of security within 
ach of these major areas. 


SELECTION or THE AREAS OF STRIVING 
Ж, choosing the areas of striving 
ithi е Ба С 
Within which to measure security feel 


ings , | 
85, an attempt was made to select 


or е h 
oad areas which would apply sere 


ә 


ally to the majority of the adult popu- 
lation. It was apparent that the areas 
could not be specific enough to include 
the multitude of unique motives we each 
have and still be useful from the practi- 
cal point of view of measuring large 
groups of people. The areas used in this 
study were chosen because they appeared 
on the basis of former reports and the 
preliminary investigation to be most per- 


tinent. 


As the first step toward determining the areas 
of striving in this study, fifteen mature indi- 
viduals were interviewed using the open-inter- 
view method. The prime purpose of these inter- 
views was to obtain some insight into what frames 
of reference people use in their discussion of 
security insofar as it applies to them personally. 
The key questions used in this preliminary inves- 
tigation were: “What do people need to feel 
secusc?" "What would you need to feel secure?” 
and “What would make you feel most insecure?” 
Numerous nondirective probes were used, and 
care was taken to avoid suggestion. 

A group of twenty undergraduate students in 
psychology was then asked to write out an 
answer to the question, “What would you need 
to feel secure?” They were asked not to identify 
their papers in any way, and to feel free to write 
frankly and honestly. 

The responses obtained in these preliminary 
investigations varied considerably, giving evi- 
dence of the unique nature of individual feelings 
of security. In spite of this variation, however, 
three general areas of striving were mentioned as 
the frame of reference very frequently. These 
were the various aspects of economic security, 
belongingness, and mental or intellectual capaci- 
ties. Often these seemed to overlap; at times one 
appeared to be regarded as a stepping stone to 
another. 

A group questionnaire was then constructed 
and given to a group of thirty undergraduates in 
psychology who were likewise instructed not to 
sign their names and to feel free to answer the 
questions honestly and frankly. In this question- 
naire the subjects were asked to rank a number 
of areas of striving in terms of importance. The 
method was similar to that previously used by 
Hyman in his study of social status (7). This 
method was not completely successful because 
e subjects appeared to have difficulty 

between some of the alternatives. It 
hese finer discriminations 


many of th 
in selecting 
was apparent that if t 
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were difficult for college students in a classroom, 
they would be far too difficult for individuals 
with less education and test experience. A 
coarser grouping seemed desirable. 

In the second part of this questionnaire, the 
subjects were asked to rate each of the areas of 
striving on a five-point scale in terms of their 
present feeling of satisfaction; then they were 
asked to rate them again on a similar scale in 
terms of the level of satisfaction they hoped to 
achieve. This attempt to obtain a measure of the 
level of security within each of the areas showed 
some promise, but it was abandoned as too com- 
plex for people with limited test. experience. 
Furthermore, individual frames of reference with 
respect to the use of rating scales seemed to in- 
fluence the nature of the final scores which in- 
volved a comparison of the two ratings. 

In addition to these ranking and rating ques- 
tions, this questionnaire again included open 
questions designed to draw out further informa- 
tion about the areas of security and insecurity. 


On the basis of the review of previous 
studies of value and ego-involvements 
and the preliminary investigations, it 
was decided to study personal security 
relative to ten areas of striving: cultural, 
social standing, intellectual, economic, 
sexual, appearances, belongingness, reli- 
gious, health, and work satisfaction. 
Concrete formulations of the areas were 


developed through pretesting, as follows: 

Having a chance to develop some special talent, 
interest, or hobby, 

Having a good social standing and the right 
kind of people as friends. 

Having a good ability to understand things, 
good education, and general information. 

Being sure of a job or steady income with good 
living conditions, 

Being satisfied in your relations with members 
of the opposite sex. 


Having good looks and appearances, good 
build, height, etc, 


Being liked and respected, and feeling you 
“belong.” 


Having a good religious understanding and 
faith, 


Being in good Physical and mental health. 

Being satisfied with your work or job, 

These areas of striving are not inde- 
_ pendent and distinct. A person very in- 
secure in the subjective economic area, 


for example, would almost certainly feel 
insecure insofar as his social status and 
his possib"ities for developing his men- 
tal and i ,tellectual capacities are con- 
cerned. Then, too, as has been suggested, 
insecurity feelings may be generalized be- 
yond the limits of an area, and insecur- 
ity in one area may be projected into 
other areas, etc, 

The advantages of using such an area 
approach offset these difficulties. The 
areas served as a framework in develop- 
ing the personal-security questionnaire 
in such a way that a weighting of the 
scores in any single direction could be 
avoided. Not enough is yet known about 
the relative importance of different 
values in terms of motivation to justify 
an overemphasis in any particular direc- 
tion. In addition to providing a frame- 
work for the questionnaire, the area ap- 
proach could be used to determine what 
people feel to be most important—what 
they say they are striving for. Thus, the 
questionnaire could be designed to ob- 
tain a measure of the gencral level of 
Security and at the same time a descrip- 
tion of the most important areas of 
striving. 


THE RANKING METHOD 


Several methods were considered as 
possibilities for obtaining a ranking ol 
the areas of striving in terms of their 
importance to the individual. In thé 
preliminary investigations, subjects "xs 
asked to rank all the values in terms Ce 
importance. This proved too difficult for 
many subjects, owing to the equal im- 
portance given to some areas and the in- 
terrelationships existing between areas. 
It was, therefore, decided to obtain а 
rougher three-way grouping. : 

Three Ways of obtaining this pu 
Were tried out in the first complete tria 
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of the Personal Security Inventory. At 
the beginning of the questionnaire, the 
concrete formulations of the fiers were 
Presented in a list and the subjects were 
asked: 


Y 


1. a. "Which three of these do you think are 
most important? 
That is, which three do you care most 
about?" 
(Make three checks in the first column.) 

b. “Which three do you care least about?” 

(Make three checks in the second col- 
umn.) 


In the second presentation, the same 
Concrete formulations of the areas were 
Presented in a different order, and the 
Subjects were asked: 


20. a, "Which three of these worry you the 
least?” 

(Make three checks in the first column.) 

b. "Which three of these worry you the 
most?” 

(Make three checks in the second col- 
umn.) 


Then, at the end of the Inventory, the 
Subjects were asked: 
42. a. “What do you think people need to feel 


most secure?” 


b. "What else?" 
с. "What do you think makes people feel 


most insecure?" 
d. "What else?" 


m the validation test of the Inventory, 
sine E subjects, there was close agree- 
the qi €tween the responses obtained Ы 
cases ifferent approaches. In nearly а 
impo; One of the three areas checked as 
е was also checked as an area 
the a about; and when responses а 
МАЕ ма questions at the end a the 
сн were coded іп terms of t E а 
areas SEN, argas; ойе or more of the 
Was j mentioned in the open qeu 
both neluded among those mentione he 
AS the ranking questions three- 

“ths of the time. 

ince it was necessary to cut down the 


length of the Inventory so as to be able 
to obtain adequate descriptive data of 
the subjects at the same sitting, one of 
the presentations had to be dropped. 
There was no adequate means of judg- 
ing the least valid of the approaches. 
The first question was retained as being 
the one least likely to elicit an emotional 
blocking. The final open questions were 
also retained as a check on the responses 
to the ranking question and in order to 
leave room for unique individual expres- 


sion. 
Tue SECURITY QUESTIONNAIRE 


The major areas of striving were used 
as a framework in developing the fixed 
alternative questions of the Personal Se- 
curity Inventory, so that undue weight- 
ing of the questionnaire in any single 
direction was minimized. The approach 
was also considered useful for disclosing 
patterns of security and insecurity which 
might then be studied more fully. 

For each of the areas, questions were 
designed to reveal the individual's own 
subjective evaluation of his success, sat- 
isfaction, and surety with respect to the 
carrying out of his purposes in past and 
present situations and group relation-. 
ships, and, also, with respect to his ex- 


pectations about carrying out his pur- 


poses and aspirations in future situations 


and group relationships. In accordance 


h the concept of security accepted for 


wit ) 
an individual who felt 


this investigation, 
unsuccessful, dissatisfied, and unsure of 


himself with respect to an area of striv- 
ing, and who was doubtful or fearful 
of the future, was considered to be very 
insecure insofar as that area of striving 
was concerned. 

With the exception of the subjective 
economic security and religious areas, 
four questions were asked relative to 
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each major area. Eight items were in- 
cluded in the economic area to permit a 
‚ better test of certain of the major hy- 
potheses of the study. The ranking of 
the religious area provided a measure 
of belief but no attempt was made to 
measure religious security. 


METHODS OF SCORING 


The security questions in the Inven- 
tory were provided with three response 
possibilities (Satisfied, Dissatisfied, Don't 
know). Of these, the positive response 
(Satisfied) was scored 7 as "secure," and 
both the negative and the doubtful re- 
sponses were scored o as “insecure.” 
Since the directions were very emphatic 
about answering every question and re- 
quested a final review of the Inventory 
to be certain that every question was an- 
swered, failure to answer a specific ques- 
tion was also scored o. | 

The assumptions here are that if a 
person does not know whether he is sat- 
isfied or dissatisfied, he is not really very 


satisfied, and by, and large the more in- 
secure person is likely to fail to answer 
more qe stions than the secure person. 
An ana sis of the doubtful and ШӨ 
answer responses for the questionnaires 
completed in the preliminary validation 
of the questionnaire bore out these as- 
sumptions. 

Using this method of scoring, а total 
security score of 41 was possible; the 
highest obtained in the present inves 
tigation was one до. It is possible that 
certain of the more discriminating items 
deserve a greater weighting than 7, but 
there was little justification for assigning 
weights in advance. 


Forms A AND B or THE INVENTORY 


To minimize the influence of item 
order on responses, two forms of ше 
Inventory were prepared. The only dif- 
ference between these two forms is the 
order of the items on page one. Forms A 
and B were distributed in alternative 
order to respondents, 


—л—= 


Ш. VALIDATION 


T primary criticism е against 
JL paper and pencil personality ques- 
tionnaires is that they have not been 
adequately validated against outside cri- 
teria. To meet this criticism, a thor- 
Ough test of validity was made of the 
Personal Security Inventory using the 
preliminary form. This was followed by 
а second validation test with the final 
form of the Inventory. 


PRELIMINARY VALIDATION STUDY 


The preliminary questionnaire was 
administered in group situations tO 
three groups of patients and one group 
9f employees of a yeterans’ hospital. 
Members of all groups were white male 
Sar veterans; all could read and write. 
The groups used were as follows: 

Neurotic group.—Fifteen male white 
War veterans who had been diagnosed by 
Members of the staff of the hospital as 
- PSychoneurotic." No extreme cases were 
included in the group; all were in an 
9pen ward and could come and go freely. 
They had been in the hospital less than 
Six months, They were assumed to be 
Very insecure. 

Кз cud group.— Twenty em 
veterans who had been hospitalized 
al treatment 


white male 


"Dd were receiving medic 
9r neurological injuries or difficulties. 
hey were assumed to be fairly inse 
Cure, 

ma Main group.—Eighteen white 
admi War veterans who had just been 
or жон to the hospital for guidance 
Фала о and who had not yet been 
staff ed by members of the hospital 
aff, 


Е 1 + 
Wa Mployee group.—Y wenty whit 
ar y 
Ous Veterans who were employed | 
ЖА | : 
Positions in the same hospital. No 


e male 
n vari- 


member of this group had a history of 
psychiatric disorder, and the group was 
assumed to be the most secure of the 
four studied. 

In addition to being white, male, and 
war veterans, the four groups were fairly 
similar in age and ïn weekly income, 
although there is some question as to the 
meaning of an income comparison inso- 
far as hospitalized veterans are con- 
cerned. 

The three groups of patients included 
a fairly equal proportion of married and 
single patients. A slightly larger propor- 
tion of the employees was married. 

Considerably more of the patients in 
each of the three groups were Catholic 
than members of other faiths. This was 
not®true of the employee group. 

When a comparison of the mean se- 
curity scores of the four groups was 
made, the neurotic group Was found to 
differ significantly from all other groups 
at the 1.5 per cent level or lower. Dif- 


ferences between the means of the other 


groups were also in the expected di- 


rection! (see table below). 


SE T Test for Neurotic 
Mean Mean vs. Other Groups 


Group N 

Neurotic 15 1378 233 — 
Medical 20 21.00 

Unclassified 18 22.17 р 

Employee 20 2495 135 


* Significant at the 1.5% level. The other values 
in this column indicate significance at the 1% 
level or lower. 

Following the validation pretest, a de- 
tailed item analysis was made on the 
basis of which several questions were re- 
vised and a number of questions added 


in order to obtain sharper group dis- 
1 These findings are not directly comparable to 


data presented in Chapters V and VI, since the 
preliminary form of the Inventory was used. 
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crimination. ‘Tetrachoric correlations 
were made between the questions in 
each of the major areas of striving. The 
questions retained were those with the 
lowest intercorrelations with other ques- 
tions relating to the same area of striv- 
ing, but which were most effective in 
differentiating the neurotic group from 
the employee group. 


FiNAL VALIDATION Srupy 


A final validation check was made of 
the Inventory using a larger number of 
psychoneurotic patients and several oc- 
cupational groups at the same veterans’ 
mental hospital. At this time the Inven- 
tory was found to discriminate signifi- 
cantly between the patient group and all 
other seven groups studied, and, also, 
between certain of the occupational 
groups themselves. These data are re- 


ported fully in Chapter VI. 

It seems important to emphasize that 
these weve group-validation studies. No 
claims ac; intended for the use of the 
Inventory in individual diagnosis. ae 
argument might be made, however, for 
the face validity of the Inventory when 
individually administered, inasmuch as 
the responses involve a person's own sub- 
jective judgment of his feelings of satis: 
faction, status, surety, and expectation 
in the areas of striving covered by the 
Inventory. In other words, a person who 
ranks low on the Inventory when it J5 
individually administered is classifying 
himself as insecure. The converse also 
holds, but the questions are all аш 
forward and frank, without concealec 
meanings or implications, so that a ре" 
son may answer them falsely if he 50 
desires. 


i * 


IV. THE SAMPLE AND DISTRIBUTION OF QUESTIONNAIRES 


‘SPONSES to the ra Security 
Inventory were obtai ed from 
three major groups: 51 students in psy- 
chology at Princeton University; 34 PSY 
choneurotic patients at a veterans’ men- 
tal hospital; and 315 employees at the 
same veterans’ hospital.* 


PRINCETON STUDENTS 


The 51 Princeton students were at- 
tending the summer session at the Uni- 
versity. Many of these students were 
making up credits because of failures 
during the previous year. All were male, 
white, and under thirty years of age; 
nearly g out of 10 were single, and 
8 out of 10 had served in the armed 
forces. 

In family income the students as a 
group were considerably better off than 
any) other sample studied. In relative in- 
come, however, the students did not dif- 
fer much from the other groups. In fact, 
there was little difference in the distri- 
butions of the four groups in relative 
income, in spite of wide differences in 
actual family income and occupational 
Status, 

Another striking di 
the student and other groups W 
higher educational and occupational 
status of the fathers of the students. 
The students also differed from other 
groups in that a much higher propor 
tion were Protestant in their church 
| ишы only 14 per cent were Cath- 
Olic, 


fference between 
as the 


PsvcuoNEUROTIC PATIENTS 
terans who 


The 34 patients were ve 
F bers of the 


had been diagnosed by mem 


я : 
be See Appendix for a more detailed c 
the sample than summarized here. 


omparison 


© 


hospital staff as psychoneurotic. They 
were selected by a staff psychiatrist as be- 
ing fully capable of taking the question- 
naire. Nearly all were in an open ward 
of the hospital and could come and 
go freely; they had been in the hospital 
less than six months. Forty patients were 
given the questionnaire; six failed to’ 
complete it and their papers were dis- 
carded. 1 

All members of the patient group were 
male, white, and veterans. About half 
of them were under thirty years of age 
and nearly all were under forty. Equal 
proportions of married and single men 
were included in the group. 

In family income the patients were 
slightly lower than the other groups, 
but there is some question as to the va- 
lidity of income data provided by mem- 
bers of this group inasmuch as all were 
receiving benefits from the government. 
In relative income they did not differ 
much from the other groups, but a 
greater proportion of the patients said 
they used to earn more than now. 

The patient group was lower in ed- 
ucation than members of other groups. 
One-third had less than high-school edu- 
cation, about half had completed high 
school, and only 12 per cent were college 
About two-thirds of them 


graduates. 
ve, service workers, 


were clerical, operati 
or laborers. Almost one-fourth of the 
patients failed to answer the question of 
their father's education, and 12 per cent 
failed to give their father's occupation, 
so that these data cannot be meaning- 
fully compared with that of other 
groups. The distribution of the group in 
social-class identification and in religious 
preference was fairly similar to that of 
the male employee group. Their ratings 
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on their own general health were lower 
than those of other groups. 


EMPLOYEE SAM PLE 


The employee sample was selected in 
such a way as to obtain the best possi- 
ble representation of the different occu- 
pational groups in the hospital with the 
least possible interference with the ac 
tivities of the hospital. Sex, income, and 
occupational description of the major 
departments was obtained and the ques- 
tionnaires were allocated within the de- 
partments in such a way as to insure 
representation of the upper and lower 
occupational groups for each sex. 

The sample included 133 white 
women and 142 white men employees, 
à total of 275 government employees 
working in the same general situation. 
They did not vary as greatly in income 
and occupation as might be expected in 
à random sample of the adult popula- 
tion. Only 6 per cent of the employees 
reported family incomes lower than 
$40.00 per week; 3 per cent reported 
incomes of $200.00 per week or more. 
As government employees, these respond- 
ents probably also enjoy more economic 
and job security than do many of those 
working in private employment, inas- 
much as discharge without adequate 
cause is not usually possible. Further- 
more, employees at the mental hospital 
are selected with an суе to avoiding 
applicants who have any history of psy- 
chiatric disorder, so as a group the em- 
ployees were considered to be somewhat 
more secure than a random sample of 
the normal adult population. 
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METHOD or DISTRIBUTING THE 
QUESTIONNAIRES 

The questionnaires were distributed 
to the P*mceton students during a reg- 
ular class session, They were handed out 
with a statement assuring the students 
that we were not interested in them as 
individuals, but only as members of » 
group; instructions were read from in 
Statement for emphasis. The students 
were asked to seal the questionnaire In 
the envelopes provided, and to drop 
them into a locked secret ballot рох. 

The patients were given the question- 
naire in a group situation similar to that 
of the students. The instructions were 
read to them, and envelopes were pro 
vided for the questionnaires. It was em 
phasized that they were not being sin- 
gled out for individual study—that © 
sample of the staff members was taking 
part in the same study. 

The questionnaires were distributed 
to the employees under the direction ol 
the chiefs of the major departments in 
the hospital. The same statement assur- 
ing the respondents that we were not in- 
terested in them as individuals, and а 
Princeton University envelope ia 
panied each ballot. The departmenta 
heads were asked to have the ballots "i 
tributed as randomly as possible within 
the occupational groups selected for 
study. Excellent cooperation was a 
ceived from all department heads. Fo! 
the most part the questionnaires were s 
turned through the department distribu" 
ting them. Frequently, however, q ad 
naires given out by one department ме! 
returned through another department- 


V. THE AREAS OF SECURITY AND INSECURITY 


T's concept of personal security ac- 
cepted as the framework [рг this in- 
vestigation recognizes any nWmber of 
functional areas within which people 
strive for security. Unique individual pat- 
terns of security and insecurity would be 
expected in addition to the varying levels 
of security in general. These unique pat- 
terns of security are considered to result 
from individual differences in family 
background, past experiences, and per- 
sonal and social purposes. In view of this, 
differences would be expected in the pat- 
terns of security of groups varying pri- 
marily in background and status, or "sta- 
поп in life." 

It should. be recalled that the sample 
was chosen in such a manner as to ob- 
tain the best possible representation of 
certain major occupational groups within 
а veterans’ mental hospital. Comparisons 
In terms of sex, age, military service, and 
other such variables were u 
€xcept when occupation cou 
constant. Most comparisons 
ture, therefore, have been post 
til such time as a sample of th 
population can be studied. 


inwarranted, 
ild be held 
of this na- 
poned un- 
e national 


OCCUPATIONAL CLASSIFICATION OF 


. Hosprrat. EMPLOYEES USED 
hich the sample was 


selected permitted grouping the em- 
Ployees into six occupational groups for 
а comparison in terms of the total secur- 
ity score, and, also, in terms of the scores 
9n separate parts of the Inventory. 

The occupational classification used in 
Srouping the members of the sample was 
that employed by the Census Depart- 
Ment in 1940. Since this classification sys- 
tem is quite thorough, and most of the 
respondents were fairly specific in describ- 
Ng their work, little difficulty was ёп 


The manner in w 
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countered. In view of the special weight- 
ing of certain specific occupations within 
the major groups, some description of 
these groups in greater detail may be 


useful. 


The male professional-administrative group in- 
cluded doctors, psychiatrists, psychologists, thera- 
pists, social and welfare workers, technical engi- 
neers, and departmental administrators. 

The female professional-administrative group 
included trained nurses, therapists, social and 
welfare workers, dietitians, and departmental ad- 
ministrators. Two-thirds of the group were 
nurses, and the security scores for the nurses and 
other women professional and administrative 
workers were similar, so that nurses were not 
treated as a distinct group in this analysis. 

The male technical, clerical, crafts, and fore- 
men group included technicians, sports directors, 
and other semi-professional employees, clerical 
workers, electricians, laundry foremen, painters 
and carpenters, non-technical engineers, etc. The 
semi-professional workers were too few in num- 
beto treat as a distinct group. As a group they 
differed but slightly from the clerical workers, 
craftsmen, and foremen. 

The female nonprofessional group included all 
female employees below the professional level. 
About two-thirds of the group were adminis- 
trative assistants, secretaries, stenographers, and 
clerical workers of various kinds. Also included 
were laundry workers, seamstre waitr 
kitchen help, housekeepers, and hostess 
distribution of security scores for the clerical 
workers was very similar to that of other mem- 
bers of this group. 

The male attendants and aides were grouped 
by the Census Department as service employees. 
Since more than 500 aides are employed by the 
hospital, a large enough sample was obtained to 
treat them as a separate group for this analysis. 

‘The male service and operator group included 
machine operators and machinists, meat cutters, 
laundry workers, truck drivers, guards and watch- 
men, barbers, storekeeper, cooks, bakers, and 


kitchen help. 


UNIQUE, INDIVIDUAL PATTERNS OF 
SECURITY 

arison of the security scores ol 

the areas of striving covered by the In- 

ventory brought to light a wide variety 

of individual differences. A number of 


A comp 
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subjects who ranked most insecure (o) 
in several areas ranked vary secure (4) in 
one or two of the areas. Conversely, some 
professional persons who ranked very se- 
cure in nearly all areas were most inse- 
cure in one or two. 

The free answer questions at the end 
of the Inventory, some of which were 
quite revealing, provided an opportunity 
for unique expression. Projection was 
clearly in evidence in many of the re- 
sponses to these questions; for example: 


"What do people need to make them feel 
secure?" 
A male foreman over 50: "Good health." 
(What else?) "Retirement at the age of 55." 
A patient: "Faith in the Lord! Realize that 
they are temporary custodians of the 
Lord's footstool and that they are allowed 
on earth to earn their way to heaven." 
"What do you think makes people feel most 
insecure?" 
A male service employee: “Lack of food more 
than clothes. Being behind in payments." 
A patient: "Lack of love and harmony in the 
home from childhood to manhood." 
A woman clerk: "Being a social outcast.” 


Tue AREAS PEOPLE CARE Most ArouT 


Health (being in good physical and 
mental health) and economic security 
(being sure of a job or steady income 
with good living conditions) were the 
outstanding choices of nearly all groups 
in response to the question: 


“Which three of these do you think are most 
important? That is, which three do you care most 
about?” 

A. Having a chance to develop some special 

talent, interest, or hobby. 

B. Having a good social standing and the right 

kind of people as friends. 

C. Having a good ability to understand things, 

good education, and general information. 

D. Being sure of a job or steady income with 

good living conditions. 

E. Being satisfied in your relations with mem- 

bers of the opposite sex. 

F. Having good looks and appearances, good 

build, height, etc. 

G. Being liked and respected, and feeling you 

"belong." ` 
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H. Having a goou religious understanding and 

faith. 

I. Being, in good physical and mental health. 

F Bein: satisfied with your work or job. 

Health was chosen as one of the most 
important areas by the overwhelming 
majority of the members of all groups- 
Economic security received second men- 
tion by all groups, except the male serv- 
ice employees (ist) and the*female pro- 
fessional and administrative employees 
(4th). 

Some variations occurred throughout, 
but the areas identified in the analysis 
as Belongingness (С), Capacities (С) 
Work Satisfaction (J), and Religion n 
were next most frequently тепиопес 
by the employee groups. Р 

There was an interesting relationship 
between general level of security ог 9 
cupational status and the selection y 
Social Status (having a good social stan® 
ing and the right kind of people 2% 
friends). A larger proportion of tie in- 
secure groups selected Social Status 25 
an area they cared most about; fewer О 
them chose it as an area they care 
least about. The regression was fairly 
regular (Table 1). j 

About one-third of the patients E 
selected Capacities (having a good abi 
ity to understand things, good educatio 
and general information) as an are 
they cared least about. Not more than E 
per cent of any other group made th! 
choice. 

Responses to the questions on 
areas cared most about and those Са! ; 
least about were found to bear a a 
close relationship to the answers tO di 
projective free-answer questions at ¢ le 
end of the interview on what рёОР 
need for security (Question 38). n 
number of things mentioned in pr 
to the open question varied е an 
Some subjects failed to give any aD5" 


the 
гей 
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TABLE 1 
А 
FREQUENCY OF SELECTION OF SocraL STATUS AS AN AREA CARED Most 
ABOUT OR CARED LEAST Авоот* 
1 - Cared Cared 
Group N Most N Least 
About About 
Male professional-administrative 29 3% 27 63% ў 
Female professional-administrative 64 3 бт 64 
Female nonprofessional 52 8 53 53 
Male attendants 35 14 37 32 
Male tech., cler., etc. 28 18 28 50 
Male service workers 27 18 2 34 
Patients 33 33 31 29 
No answer 3o 32 
Number of cases 298 298 


“Ң This table is based on responses to Par 
aving a good social standing and the righ 


and others mentioned as many as five or 
SIX things. 

A few subjects also [ailed to answer 
the question on the areas they cared 
most about. Some of these Wrote com- 
ments such as "All of these areas are 
equally important," ог «т don't care 
least about any of these." Some checked 
all of the areas as things they cared 
most about. 

Arras or SrrivinG TEND TO ВЕ AREAS 
Ок INSECURITY 


The preliminary investigations had 
Suggested that the things people say 
they, care most about tend to be the 
things about which they feel most inse- 
cure. The final study yielded further 
Support for this. - 

In making analysis of the relationship 
between the areas of striving respondents 
cared most about and the levels of se- 
curity within these areas, it was nec 
essary to assume that the groups of ques- 
tions chosen to measure security feel- 
ings within the different areas were of 
approximately the same discrimination 
value, If this were not true, 21У rela- 


tionship existing might ver) well be 


t I of Inventory. The Social Status area was formulated: 
t kind of people as friends.” 


concealed by the inadequacies of the 
questionnaire. | 

In constructing the Inventory, 
questions were included to measure se- 
curity within each of the areas, except 
the religious and economic-security 
areas. The question objectives for the 
different areas Were similar, even though 
the actual wordings of the questions var- 
ied. In general, for every area one ques- 
tion was concerned each with satisfac- 
tion with present status, status relative 
to associates, feelings of surety, and ex- 
pectations. Some evidence that the 
groups of questions representing the dil- 
ferent areas have approximately similar 
discrimination value was the fact that 
the mean area security scores did not 
vary greatly either within the most sc 
cure groups Or within the least secure 


groups. For the male professional and 
in area 


administrative group, the range 

mean scores was from 2.6 to 9.5: for the 

neurotic group it was from 1.4 to 2.4. 
Rank-order correlations were made 


four 


made to measure religious 
stions were concerned with 
d half the mean score was 


1No attempt was 
security. Eight que 
economic security, an 
used in making comparisons. 
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between the areas of striving selected by 
the different groups and the mean secur- 
ity scores for the areas to test the thesis 
that subjects tended to be most insecure 
in the areas they cared most about. The 
health area was left out in making this 
analysis because health was consistently 
ranked highest or second, although the 
employee groups were all relatively very 
secure in this area. The religious area 
was also excluded because the Inventory 
contained no religious-security score. 


Biserial correlations could not be used in mak- 
ing this analysis because the general level of 
security and also the levels of security within 
the areas varied directly with economic and occu- 
pational status (Ch. VI). Furthermore, the areas 
of striving cared most about also tended to vary 
to some extent with occupational status, It was 
clear that any analysis using biserial correla- 
tional techniques would be meaningless unless 
the sample used were large enough to keep both 
occupation and general level of security constant. 
The present sample did not permit this finer 
control. 

This analysis made by occupational group indi- 
cated that there was a fairly strong and consistent 
tendency for the areas of greatest insecurity, as 
measured by the Inventory, to be the ones cared 
most about. The rank-order correlations were 
greater than .65 for most of the groups studied. 
The exceptions were the male professional and 
administrative employees (.45), the female pro- 
fessional and administrative employees (.35), and 
the patients (.39) (Table 2). 

Although the correlation between areas cared 
most about and areas of greatest insecurity for 
the patient group was only .39, a correlation of 
77 maintained between the areas cared least 
about and the areas of greatest security, "Thus 
the patients tended to be most secure in the 
areas they cared least about. For other groups, 


the two approaches yielded essentially the same 
correlations. 


There is evidence that the fairly high 
rank-order correlations between areas 
cared most about and areas of insecurity 
does not reflect a pattern peculiar to the 
employee group; this relationship was 
found to be fairly close for Princeton stu- 


dents (.87) and for a smaller group of 
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TABLE 2 
RANK-ORDER CORRELATIONS (Кно) ВЕТА E. 
AREAS OF STRIVING SUBJECTS CARE Most Аво 
AND AREAS (© GREATEST PERSONAL 


Number 


of Rho 

Cases 
Male professional-administra- А 
tive employees Р 20 -45 
Female professional-adminis- _ 
trative employees 64 -35 
Female nonprofessional em- 26 
ployees . 16 


Male attendants 
Male technical, clerical, fore- 86 
теп 28 sop 
27 


5 а 86 
Male service and operatives 86 
Princeton students 51 #8 
Social welfare organization em- m 
ployees 20 uS 
x 
Psychoneurotic patients е 33 39 
Ко answer to Question No. 1 3 — 
Number of cases 369 


1 " east 

* Rho between arcas patients cared e 

about and areas of greatest personal securit 
was .77. 


employees of a social wellare organize, 
tion, also (.88). 


PATTERNS OF SECURITY TEND 10 VARY 
WITH STATION IN LIFE 

Cantril (3), Horowitz (6), and others 
have pointed out that the pattern of à 
person's areas of security and insecurity 
will tend to be a function of his past 
experiences, present situation, group 1er 
lationships, etc. According to this thesis 
there should be a relationship between Of 
cupational status and patterns of security. 
Groups that are most alike in occupa 
tion would be expected to have the most 
similar patterns of security. An analysis 
of the present data showed a consistent 
tendency in this direction. 

The mean area security scores of the 
occupational groups were ranked in ei 
order of security level, with the rank С 
г being given to the area of greatest 
insecurity as measured by the Inventory 


‘ 
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9 TABLE 3 
Р RANKING OF MEAN AREA PERSONAL SECURITY SCORES BY OCCUPATIONAL Group 
‚ , Male role Female Male Male 
Area of security Prof. Prt. non- Ale rai; Serv. Patients Pune 
Adm. E ^ : КҮ 3 ? Student 
Adm Adm. prof. Fu Oper. d 
Economic 
I 1.5 1 1 I 5 
Cultural 2 I ЙС 4 TES 7 С : 6 
elongingness 3 Sea 5 2 f Sa 7 5 
apacities 2 š A 2 3 3s 
ODE 4-5 5 5 6.5 4 3-5 6.5 145 
Soc s du 8 8 8 9 5 8 9 
тоса) Status 6 6 7 6.5 5 7 2 7 
gore Satisfaction 7 7 3 3 2 2 4 ae 
Henith 8 4-8 6 4-5 6 8 6.5 3 
9 9 9 9 8 9 1 8 
Nore: The Census Department occupational classification system was used in grouping these 
of the occupational groups. In presenting this 


ріні employees. See page 20 for 

clea there is one variation п 

ES ical, and craftsmen were shifted below 
nsidered more like that of the service emp 


For the employee groups. economic se- 
curity consistently received the lowest 
ranking (insecure), and health was con- 
Sistently ranked 8th or gth. Other secur- 
ity areas varied in rank. The patterns of 
both patients and Princeton students dif- 
from the employee 
Table 3): 
then 


fered consistently 
groups and from each other ( 

Rank-order correlations were 
made between the mean security scores 
for the individual areas of striving by 
Occupational group (Table 4). Groups 


a fuller discussion 
ion from the Census Departmen 
the male attendant group. T 
loyees than like that of the professional employees. 


The male technical, foremen, 


t classification. 
he nature of their work was 


most similar in occupation tend to have 
ecurity that are most alike. 
the patterns of security of 
widely in occupation 
slightly related. This 
s they care most 


patterns of s 
Conversely, 
groups differing 
tend to be only 
is also true in the area 
about and care least about. 

Security in the work-satisfaction area, 
compared with the security level in other 
tended to increase with occupa- 
ne time there was 
rity level in the 


areas, 
tional status. At the san 
a tendency for the secu 


TABLE 4 


› RANK-ORDER CORRELATION 


s (RHO) BETWEEN M 


[EAN AREA PERSONAL SECURITY 
PATIONAL GROUPS 


Scores OF DIFFERENT OCCU 
` Male Prince- 
Male Female Female Male Tech. Vel TEA Ton 
Group Prof. Prof. non- Attend. Cler. 0 en Stu- 
Adm. Adm. Prof. rmn. pe dents 
— 
Male Prof.-Adm. 72 .68 .57 .36 .64 —.20 = .01 
emale Prof.-Adm. 72 -73 -74 -45 -35 —.20 —.34 
Maule Nonprof. “68 ‚73 .96 .85 .82, .02 .54 
~ e Attendants .57 .74 .96 .82 +79 06 .49 
Tale Tech., Cler., etc 36 -45 -85 82 > .88 29 -59 
ale Sery. ers 164 .35 .82 .7o .88 —.13 до 
Patients nx. .o2 .o6 20 33 .02 
Р i 2 
Finceton Students —,01 -34 -54 :49 -59 Me 92 
ы Те * 


nai 
V 
Хоть; See note to Taole 3- 
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cultural-activities area, relative to that 
in other areas, to decrease with higher 
Occupational status. These trends are 
considered subjects for further study 
with a greater and more varied sample, 
The data further Suggest that insofar 
-as this employee sample is concerned, at 
least, occupational status and the things 
associated with it have a greater bearing 
than sex difference upon patterns of se- 
curity. The patterns of security of the 
female nonprofessional employees are 
more like those of other nonprofessional 
employees than like those of the female 
professional and administrative ет. 
ployees. Their group security pattern is 
most closely similar to that of the male 
attendants (.96) whose status is most like 
their own. The group pattern of the fe- 
male professional and administrative em- 
ployees, on the other hand, bears about 
the same relationship to that of the male 
attendants (.74) as it does to that of 
the female nonprofessional group (.73). 
The patterns of security of the patient 
group differed greatly from those of all 
other groups studied, the highest correla- 
tion with any group being .29. Thus, the 
patients were found to be а distinct 
group both in the low level of security in 
general as measured by the Inventory, and 
in the unique pattern of the areas in 
which they feel most and least secure. 


Princeton students differed most from 
the patients and from the male and fe 
male professional and administrative 
employees»: Their group pattern of se- 
curity bore the greatest resemblance to 
those of the female nonprofessional, 
male attendant, and male technical, fore- 
men, and craftsmen groups, but the rela- 
tionship was not great. 

It should not be inferred from these 
data that the relationships found be- 
tween occupational status and patterns 
of security reflect the influence of occu- 
pation alone. Occupation, income, edu- 
cation, family background, etc., are all 
closely related, so that a comparison 1N 
terms of occupation provided but ons 
means of getting at what might better be 
called a person’s “station in life.” тве 
conclusion here is that an individual's 
patterns of security and insecurity are 
closely related to his station in life. 

It is important to emphasize that some 
factors that probably influence gren 
of security, such as age, religion, anc 
marital status, could not be held et 
stant in this analysis. On the other hand, 
the employee sample was considered tO 
be more homogeneous than a sample а 
the national population would be т 
terms of age, veteran status, education, n 
come, place of employment, and nature 
of work. 


bI 


VL THE GENERAL LEVEL OF SECURITY 


P eie of the data obthined in the 
preliminary study in icated the 
presence of a general security level as 
well as levels of security within the vari- 
ous areas of striving. At that time ques- 
tions concerned with subjective eco- 
nomic security and work satisfaction 
seemed to provide an index to this gen- 
eral security. 

In the final study, several methods 
were used to investigate more fully this 
relationship between economic security 
and security in areas of striving. Support 
was found for the hypothesis that per- 
sons who lack economic security tend to 
feel insecure in the more developmental 
areas of striving, such as belongingness, 
Sex, personal appearance, cultural ac- 
tivities, etc. 


THE PROBLEM or MEASURING ECONOMIC 
STATUS 


The relationship between economic 
status and feelings of personal security is 
a particularly difficult one to investigate, 
because income is tied up with other im- 
Portant variables, such as abilities and 
capacities, health, family background, so- 
cial, status, and education. Education 
and social status, for example, normally 
parallel economic status in our society; 
the individual who has wealth yet lacks 
education and social standing is an €x- 
ception so far as our culture is con- 
cerned. 

_ There is also the pr 
ing what an individual's real inco! 
It is hazardous to compare incomes 
Out taking into account such thin 
local living costs, the size of family, ages 
Of children, etc. We might agree that a 
man supporting a wife and a child on an 
income of $3,000 is better off than his 


oblem of determin- 
ne is. 
with- 
gs as 


sh 


neighbor who is supporting a family of 
four or five on the same income. It is 
more difficult, however, to determine ob- 
jectively how much better off he is, and 
how his economic needs vary as his 
family grows up. 

A number of subjective factors should 
be considered in making economic com- 
parisons. There is the problem of pres- 
ent income compared with previous in- 
come, and also compared with the in- 
come one may expect to have in the fu- 
ture. Furthermore, economic needs vary 
according to one's position in life and in 
the community; one's own income rela- 
tive to that of other members of his mem- 
bership groups must be considered. 

In this study several approaches were 
зей in an attempt to obtain а meaning- 
ful answer to the problem of the rela- 
tionship between economic security and 
security in other areas of striving. Data 
were obtained on the income of the im- 
mediate family, subjective economic 
status and work satisfaction, income rela- 
tive to that of associates, and satisfaction 
with opportunities for personal develop- 
ment. 

Occupational data provided a better 
measure of personal earnings than did 
the information on income of the im- 
mediate family, because the latter also 
included the earnings of other members 
of the family. Occupation is a measure of 
job status and social status, as well as of 
economic status, and to a certain degree 
serves as an index to opportunities for 
personal development. Most people need 
a certain amount of family and other 
support to achieve the higher profes- 
sional positions. To some extent per- 
sonal ability is also reflected in occupa- 


tion. 


20 A. L. KNUTSON 


TABLE ; 


COMPARISON or MEAN PERSONAL SECURITY Scores or Hosprrat EMPLOYE: 


ES DIFFERING 


IN RELATIVE INCOME AND SATISFACTION WITH OPPORTUNITIES 


SE 


N Meran d SD Mean | 
Dissatisfied with Opportunities and— 4 18 
ower relative income 25 21.12 7.58 68 
About the same or higher 66 22.50 5.52 . 
Satisfied with Opportunities and— nas 
Lower relative income 35 25.38 7-71 Ж 
About the same ог higher 139 29.01 5.96 
No answer 10 
Number of cases 275 


а ® г НИН cause 
* One point has been deducted from the mean scores of those satisfied with opportunities, be 


one point was given for a “satisfied” response in computing the tot: 


question on relative income in making a 
breakdown of the employee sample, a 
very decided relationship to leve] of se- 
curity was indicated (Table 5). Data on 
male and female groups were combined 
in making this comparison since no difrer- 
ence in response was observed. 


Occupation? 


A comparison of occupational groups 
in term of the mean security scores 
(Table 6) shows a consistent relationship 
between level of Occupation and level of 


2 See Page 21 for a detailed description of the 
occupational classification of hospital employees, 


al security scores. 


security, which is true for both male and 
female groups. Since all respondents 
were employed in the same hospital, ber 
cupation represents both income and pe 
Status. The male professional and p 
ministrative employees, for bw 7. 
tend to be the best paid and also ho E 
the most respected positions. Bota 9 
these factors need to be considered in in- 
terpreting the relationship. | 
A rise in the mean security score | 
occupational level is accompanied by s 
decrease in the variability of the яе 
Scores. A number of those in the уу 
occupational groups had high securit 


TABLE 6 
MEAN PERSONAL SECURITY Scores 


Comparison between Hospital Employees 


(classified by occupational level), 


rinceton Students, and Psychoneurotic Patients 


E Mean Diff. Sign. 
Group N Security SD UE from other 
Score com groups 
8 
Male, prof.-adminis, 3o 32.50 4.01 -73 2, 3, 4, 5» бї 
emale, prof.-adminis, 67 28.61 7.52 +92 т, (5), 6, 7 
Princeton students 51 26.55 5.59 .78 1,8 
Male, technical, clerical, foremen 31 26.29 6.96 1.25 1,8 
Male, attendants and aides 40 25.93 5.67 -90 1, (2), 8 
emale, nonprofessional 64 24.63 6.45 .8т 1,2,8 
Male, service and machine operators 32 24.41 7.28 1.29 туя, 9 6,7 
Psychoneurotic patients 34 19.06 0.51 1.80 I, 2, 3) 41 51% 


* Parenthesis enclosing the group number, e.g. (2), indic. 


the .or level of confidence is indicated. 


wise, 
ates the .o5 level uf confidence. Other 
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о TABLE 7 


MEAN PERSONAL Security Scores, EXCLUDING Economic-Work-SATISFACTION ITEMS 
Comparison between Hospital Employees (classified by occupational level), 


—I] and Psychoneuritic Patients 


N Mean SE Diff. Sign. 

Group N Boore SD Mean from other 
groups 

Male, Prof.-adminis. 30 22.03 1 56 2 5 

Female, prof.-adminis. 67 19:82 3161 бо n 4 $ SERES 

Princeton students 5I 18.51 4.60 -44 ns 

Male, technical, clerical, foremen 31 19.61 5.02 -90 " 8 

Male, attendants and aides до 19.10 4-37 -69 1,8 

Female, nonprofessional 54 18.33 4.66 -58 1,8 

Male, service and machine operators 32 17.63 5-31 -94 1,2,8 

Psychoneurotic patients 34 13.29 7.09 1.22 1, 2, 3, 4y 56,7 


scores; none of the male professional- 
adininistrative group had very low se- 
curity scores, 

A possibility was recognized that the 
differences between groups might pri- 
marily reflect differences in responses to 
the economic- and work-satisfaction ques- 
tions. If this were’ true, the differences 
could be interpreted as reflecting income 
only. The groups were therefore com- 
pared in terms of both their responses to 
the questions relating to subjective eco- 
nomic security, and those relating to se- 
curity in other areas of striving. 

When this comparison was made 
(Table 7, Table 8), it was found that 
the noneconomic questions differentiate 


between the groups more clearly than do 
the subjective economic-work-satisfaction 
questions. The latter questions supple- 
ment the rest of the Inventory very well 
in spreading out the scores. It should 
be noted that the lower occupational 
groups do not differ very much from the 
psychoneurotics on the economic-work- 
satisfaction questions, This may be at- 
tributed to the fact that the psycho- 
neurotic group consists entirely of vet- 
erans who are assured of pensions, medi- 
cal and financial assistance during ill- 
ness, and aid for limited periods of unem- 
ployment, which was not true of the ma- 
jority of the employees below the pro- 
fessional level. 


Mean Economic-W: 


TABLE 8 


ORK-SATISFACTION SECURITY ScoRES 
yees (classified by occupational level), 


k aris een Hospital Employ l с 
udoeh: Г р Psychoneurotic Patients 


Princeton Students, and 


ы а a m Diff. Sign. 
"ean from other 
Group N Score SD Mean groups* 
Male ini o 8.60 1.83 +33 31 4, 51 6, 7,8 
, prof.-adminis. 3 
Female, Bob Залив, 67 8.19 2.78 +27 41 516, 7,8 
"rinceton students 51 7-33 2.71 .38 т, (4), 6, 8 
ale, technical, clerical, foremen 31 6.06 SEE -57 1,2, (3) 
ale, attendants and aides 40 6.35 2.3 37 1,2, (8) 
emale, nonprofessional 64 5.78 201 E 1,2,3 
ale, service and machine operators 32 6.16 124 -45 1,2 
Sychoneurotic patients 34 5-09 255 Hi 1, 2, 3, (5) 


* ө = 
th Parenthesis enclosing the gro 
€ .or level of confidence is indicated. 


the group number, e.g. (4), 


indicates the .os level of confidence. Otherwise, 
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EDUCATION 


The employee sample used in this 
study was selected in such a manner as 
to obtain adequate representation of the 
various economic and occupational 
groups within the hospital. In view of 
this, the educational distribution ob- 
tained cannot be considered representa- 
tive either of the normal adult popula- 
tion or of the employees of the hospital. 
The upper educational levels are heavily 
over-represen ted: 


РИТИ .. Male Female All 
Employees Employees Employees 
No зсһоойпр....... — — 
Grammar School 
(© ЕБ aussen. 1895 7% 13%, 
Part of High School 
(Gr. 9, 10, 11) ... 19 9 14 
Finished High School 
{Ой 19) «2. 21 20 25 
Part of College .... 20 31 25 
Finished College ... 22 24 23 
No answer ....... — — => # 
Е 100%, 100%, 100% 
Number of cases .. i 12 133 275 


For the men employees no general 
trend іп the relationship between educa- 
tion and the security level was observed; 
however, a sharp increase in security oc- 
curred at the college graduate level (Ta- 
ble 9). There was no such sharp rise in 
Security at the graduate level for the 
Women employees. The trend here was 
more consistent, with a somewhat greater 
break occurring between the group with- 


out any college education and those who 
had attended but not finished college. 
This was bclieved to reflect the prepond- 
erance of arses among the professional 
women employees. A college degree is not 
required of registered nurses, but they are 
required to have a number of years of spe- 
cialized training. 

The absence of a consistent relation- 
ship between education and level of se- 
curity of the employee group as a whole 
and for the two sex groups suggests that 
education, per se, does not have a great 
bearing on the general level of security, 
except insofar as additional education 
brings with it additional income and 
status. This is a problem for further ex- 
ploration, 


CONCLUSIONS 

Studies by Bakke (172), Hall (5), Rund- 
quist and Sletto (9), Stauffer and Lazars- 
feld (10), Zawadski and Lazarsfeld (12), 
and others have shown that during peri- 
ods of unemployment, depression, and 
economic stress, personalities undergo 4 
severe breakdown. People lose confidence 
in their abilities, lack feelings of status 
and belongingness, and sometimes even 
lose hope. 

The present findings differ from these 
in that they are based on a study of aor- 
mal, relatively secure, employed people- 
None of the employees in the present 


TABLE 9 


MEAN PERSONAL Security SCORES or HOSPITAL Емргоү 
Сотрагіѕоп by Education 


5 Е 


Level of Educati Security 
ucation N ©соге SD Mean ig 
Grammar school—part of high school 8 
Finished high school p Ep. A p ү 
Part of college 70 26.99 6.80 81 
Finished college 63 30.40 болу 78 
No answer : 


Май 


Total number of cases 


PERSONAL SECURITY 


study had any history of psychiatric dis- 
order. They did not differ widely in in- 
come. Within this relatively; homogene- 
ous sample of employed apple a con- 
sistent relationship was found between 
economic security (especially, subjectively 
measured security) and feelings of secur- 
ity in the more developmental areas of 
striving. 

Whether weekly income of the immedi- 
ate family, subjective measures of eco- 
nomic security and work satisfaction, 
relative income, relative income and sat- 
isfaction with opportunities for develop- 
ment, or occupational status was used as 
an index to the level of economic security, 
a positive relationship between economic 
security and the level of security in other 
areas of striving was found to exist 
within the employee sample. The rela- 
tionship remained when all economic, 
and work-satisfaction items were re- 
moved from the personal security score, 


AS RELATED TO STATION IN LIFE 23 


to give a more limited measure of se- 
curity in the other areas of striving. 

The possibility existed that the re- 
sponses to the subjective economic- and 
work-satisfaction items represented in 
good part a projection of feelings of se- 
curity or insecurity in other areas of 
striving. However, the relationship be- 
tween economic security in other areas 
also exists when other measures of se- 
curity, such as relative income, educa- 
tion, and occupation are used as measures 
of economic security. Therefore, if pro- 
jection occurs, it is not wholly responsi- 
ble for the relationship. 

It should be noted that the total secur- 
ity score used in this analysis is a com- 
posite of the security scores for nine 
major areas of striving. No conclusions 
are drawn from the data in regard to the 
relationship between economic security 
and security level within any other single 


area. 


УП. SUMMARY AND CONCLUSIONS 


HE general purpose of this study 
Es to investigate the nature of per- 
sonal security to determine what it 
means psychologically, and to gain some 
insights about correlates of personal se- 
curity. This involved formulating a 
working concept of security from the 
existing literature and applying it in a 
concrete situation. 

A preliminary concept of security was 
formulated and was used as the frame- 
work in constructing a Personal Security 
Inventory. The Inventory was then ad- 
ministered to a sample of employees in 
à veterans mental hospital and to a 
group of patients who had been classi- 
fied by psychologists and psychiatrists 
as psychoneurotic. It was also adminis- 
tered to a group of students in psychol- 
ogy and to a smaller group of employees 
of a social welfare agency in New York 
City. 

A person's feelings of security or in- 
security involve his own subjective evalu- 
ation of his success, satisfaction, and 
Surety or confidence with respect to carry- 
ing out his purposes in past and present 
situations and group relationships; also, 
his expectations, hopes, fears, or uncer- 
tainties about the carrying out of his 
purposes and aspirations in future situa- 
tions and group relationships. A ques- 
tionnaire constructed to measure these 
subjective feelings was found to discrimi- 
nate between groups of individuals who 
were ostensibly secure and those classi- 
fied by psychiatrists as “insecure” (Chap- 
ter III on Validation). 

People strive for security. By and 
large, the things they consider most im- 
portant, that they care most about, tend 
to be the things about which they feel 
most insecure. Conversely, the things 
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they care Vast about tend to be the areas 
in which they feel most secure. This rela- 
tionship, while consistent, was revealed 
to be somewhat less pronounced for per 
sons of higher professional status, possi- 
bly due to a more objective attitude on 
the part of such persons (Ch. V on 
Areas). 

There are functional areas 
which people feel secure or insecure, and 
unique patterns of security exist within 
even a fairly homogeneous employee 
population. In addition to these unique 
individual patterns of security and in- 
security, broader group patterns are pres- 
ent. The patterns of security of very 
similar occupational groups are more 
alike than are those of more distantly re- 
lated occupational groups. Occupation, 
income, education, etc., were all closely 
related within the population studied, 50 
that occupational status provided but 
one measure of what might be called n 
person's station im life; therefore, it !5 
concluded that an individual's patterns 
of security and insecurity are closely 1€ 
lated to his station in life (Ch. V OP 
Areas). А 

А general level of personal security 
tends to be present in addition to the 
levels of security within the individual 
areas of striving, This seems to occur be 
cause the areas of personal striving are и 
terrelated and overlapping, even thoug^ 
some are of greater importance ihe 
others to the security of the individua 
(Ch. VI on General Level of Security): 


within 


QUALIFICATIONS 


EL j В пас 
It is important to re-emphasize Ч 


ә ж i a 
these findings are based primarily ош d. 
study of three main groups of md 
uals: employees of a veterans’ men 
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hospital, Princeton University students 
of psychology, and patients diagnosed by 
psychiatrists as psychoneuroticy The gov- 
ernment employees, who comtyrised the 
major sample, did not vary as widely in 
16S; veteran status, income, and occupa- 
tion as would be expected of the general 
adult population. It is believed, there- 
fore, that differences found between the 
occupational groups of this employee 
sample are relatively less than those 
existing in more varied populations (Ch. 
IV on Sample). 

On the other hand, special conditions 
existing within this major sample may 
be responsible for some of the relation- 
Ships observed. The findings are consid- 
ered evidence of probable relation- 
Ships within the normal adult popu- 
lation which need to be investigated morc 
fully. 


Tur PERSONAL SECURITY INVENTORY 

The Personal Security Inventory de- 
veloped in the course of this investiga- 
tion was constructed to measure security 
feelings in terms of the concept of per- 
sonal security described above. It was 
found valid for discriminating between 
patients diagnosed by psychiatrists as 
“psychoneurotic” and all occupational 
groups sampled from among the em- 
ployee population of the hospital. The 
patients were found to differ in their 
scores on this Inventory from other 
groups, both in terms of their general 
level of security and in their patterns of 
security (Ch. VI on General Level and 
Ch. V on Areas). These validation 
studies involved groups rather than indi- 
viduals, and no claims are made beyond 
suggestive validity of the Inventory in 
individual diagnosis. 
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APPENDIX A 


TABLE 10 
COMPARATIVE DESCRIPTION OF SAMPLES STUDIED* 


White White Princeton Psycho- 
Male "male — Psychology оше 
Employees Employees Students Patients 
Number of cases 142 133 51 34 
AGE: e dé 2207, 
Under зо years 49% 100, 33 40 
Between зо and 39 years 32 ie m 
Between 40 and 49 years 12 E 
50 years or over 7 Е 
No answer 
MARITAL Status: " of 
Married os“ 32% 12% are 
Single 25 6o 88 41 
Divorced 5 6 == 6 
No answer 2 2 "= 9 
BIRTHPLACE: o. 
New York City area (5o-mile radius) 47% 48% 39% 4470 
Elsewhere in Ünited States 41 48 55 56 
Outside United States 12 3 6 di 
No answer = I — xd 
MILITARY SERVICE: РТ 
Үеѕ 85% 18%, 80% 100/0 
No + 1$ 82 20 ж 
No answer — — — = 
FATHER’S EDUCATION: ; 
No schooling 12% 2% : 15% 
Grammar school (Grades 1-8) 55 38 8% 3? 
Part of high school (Grades 9, 10, 11) 9 13 12 y: 
Finished high school (Grade 12) II 17 13 9 
Part of college 3 8 20 3 
Finished college 4 14 47 6 
No answer 6 8 — 23 
FAMILY Income: Tu 
etween $ 20.00 and $ 29.99 per week 1% 1% -— 0% 
Between $ 30.00 and $ 39.99 per week 6 5 4% 21 
Between $ 40.00 and $ 59.99 per week 45 22 2 29 
Between $ 60.00 and $ 79-99 per week 16 19 8 18 
Between $ 80.00 and $ 99.99 per week 14 20 14 3 
etween $100.00 and $199.99 per week 13 25 25 15 
$200.00 a week or more 1 5 47 $ 
No answer 4 3 — s 
AVERAGE NUMBER oF PERsoNs LIVING ox 
THIS INCOME 2.96 2.77 3-6 3-53 
COMPARISON ОЕ PRESENT INCOME WITH Past 
INCOME: ao 
Used to earn more than now 5% c7. с; 53/0 
J % 29% UA 
Used to earn about the same 33 Р 2910 oe s 18 
Used to earn less 38 47 27 26 
No answer or con't know 6 " | $ 3 


* See text or other tables foi 


T : 3 ” ге!а- 
x. de Т description of the samples in terms of education, occupation, and 
tive income. 


об 
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o " 
TABLE 10—(continued) 
White White Princeton Psycho- 
g g Male Female Psychology neurotic 
y Employees Employees Students Patients 
ploy 
FATHER'S OCCUPATION: А " " 
Professional workers 8% 15% 27% % 
Semi-professional workers 1 2 2 5 
Farmers and farm managers — , 6 7 a as 
Proprietors, managers, and officials, except 
farm 2 9 2 9 
Clerical, sales, and kindred workers 8 TI ae 2 
Craftsmen, foremen, and kindred workers 12 8 І 2 
Operatives and kindred workers 25 у m 32 
Service workers 7 7 = 7 
Laborers її 5 2 15 
Students 
usiness men—unspecified 6 5 24 ж 
xecutives, bankers, brokers. etc. = T 33 ES 
Small businessmen 9 A = Е 
No answer 5 5 В a 
Ѕостдт, Crass: РЯ 
ower class Pug ; e; 20; 
Working class 53 33% 4% 47% 
Middle class 44 бт 55 4r 
Upper class 1 3 39 
No answer Тә 3 x 8 
Сниксн PREFERENCE: " А 
Ghe ERENCE: 43% 45% 34% % 
Protestant 45 49 2 i 
Jewish 9 2 6 
Other 2 2 9 
= 3 


No answer 


APPENDIX B 
PERSONAL SECURITY INVENTORY 


А 
INSTRUCTION SHEET j! 
This is a Public Opinion Poll 


The Office of Public Opinion Research of Princeton University is making a ei 
of what people want out of life—what makes people happy and what makes peop ү 
ипһарру. The Manager has kindly permitted us to interview a large number о 
persons like you. We need your cooperation. 

Please check this public opinion questionnaire in privacy. 

Remember: This is a Public Opinion Poll. 

DO NOT SIGN YOUR NAME 
No one can ever know what you personally answer. 


Directions 
1. Please read each question through carefully 
2. Answer questions in the order in which they appear. А 
3. Answer every question. This is important. If the answers given do not quite fit 
your situation, check the one that Comes nearest to what you want to say. 
4. Remember, your own honest and frank answers are the only "right" answers. sd 
5. When you are through, make a double check to be sure that you have not misset 


any question. But do not make any changes in the answers you have checked. 
6. Be careful to follow instructions. 


7. When you are through, seal your questionnaire in the envelope. 
DO NOT MARK THE ENVELOPE IN ANY WAY 


The envelopes will only be opened by the Office of Public Opinion Research. 
Thank you for helping us. 


before checking your answer. 


Office of Public Opinion Research 
‚ Princeton, New Jersey 


OFFICE OF PUBLIC OPINION RESEARCH 
PRINCETON UNIVERSITY 


Parr I 
Here is a list of things of importance to all of us. But we do n 
least important of them, 
à. Which three of these d 
about? 
Make check marks in the first column in front 
b. Which three do you care least about? 


Make check marks in the Second column in front of the three things you care least about. 
(There should now be three check marks in each column.) 
Care most Саге least 


> nd 
ot agree about the most important à 


E Е ^ " ost 
o you think are most important? That is, which three do you care m 


of the three things you care most about. 


about about 
A. Having a chance to develop some special talent, interest, or vM 
E——— == B. Having a good social standing and the right kind of people 9s ү 
n E G Having a good ability to understand things, good education 
general information. 
Form A. 


Copyright, 1948, Andie L. Knutson, Research Associates, O.P.O.R., Princeton, N.J. 
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о 

D. Being sure of a job or steady income with good living conditions. 
E. Being satisfied in your relations with members of the opposite sex. 
F. Having good looks and appearances, good build, height, etc. 7 
G. Beir,z liked and respected, and feeling you “belong.” 
H. Having a good religious understanding and faith. 
I. Being in good physical and mental health. 
J. Being satisfied with your work or job. 


Part П* 


satisfied or dissatisfied with the following things, as far as you personally 


At the present time, are you 
are concerned? i 

For example, the first item is: 

Are you satisfied or dissatisfied with the 

If you are satisfied, make a check in the с 

If you are not satisfied, make a check in 0 

If you don't know whether you are satisfied or not, та 


know. 


amount and kind of food you can afford to buy? 
olumn marked Satisfied. 


he column marked Dissatisfied. 
ke a check in the column marked Don't 


(When you are through, there should be one check for each of the eight things listed.) 


Satisfied Dissatisfied Don’t Know 
& food you can afford to buy. 


‘The amount and kind of 


1 _— 

og ушш ER Macarius time you have for the things you want to do. 

3. ——— — — Your present chances of keeping (or getting) a good job. 

4 — Mp The place you can afford to live in. 

5. ——— —— ‘The clothes you can afford to buy. 

6. — — The chance you have to get the education you want. 

T — = _ — The chances you have of a steady income when you grow old. 
8. —— — = The chances you have of a steady income and help if you are sick. 


pplies to you personally. ~ 

he only "right" answers. 

—— Satisfied 

— —Dissatisficd 
— ——pon't know 


For the following questions, check the answer that а 
Remember, your own honest and frank answers are t 
9. Taking into account the way your life is and so on, are you satis- 
fied or dissatisfied with the opportunities you have to develop 
your interests, talents, and abilities the way you would like to? 

——Yes 

No 
Don’t know 


a fecling of self-importance and 


10. Does the work you do give you 
success, or not? 


Yes 
No 
Don't know 


st, talent, or hobby that gives you a 


11. Do you have any special intere 
fecling of success? 


Satisfied » 
.— — Dissatisfied 
—— Don't know 


12. By and large, are you satisfied or dissatisfied with your health at 
present? 


_—_—Feel sure 
__—Feel unsure 
Don’t know 


18. Do you feel sure of your social acts and manners, or do you feel 


unsure of yourself socially? 


_____Tended to help 
ended to stand in way 


our looks and appearances have tended to 
——— —pon't know 


14. Do you think that y ) 
: ded to stand in the way of your getting 


help you, or have ten 
ahead? 


15. Are you satisfied or dissatisfied with the chances you have to get 


the job you want? 


16. Do you feel sure that people are interested in ЈОШ ne and 
what you are going to do, or do you wonder whether they are 
interested? 


+ 
Item 22 was not scored ir the early form of the 


—— ——Satisfied 
Dissatisfied 
—Don’t know 


. — — Sure are interested 
——— Wonder if interested 
Don't know 


inventory described in this report. 
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17. Do you feel satisfied or dissatisfied in your relations with mem- 
bers of the opposite sex? 
{: 
18. Do you feel sure of finishing things you start? h 
" t 
19. Áre you planning now to do something on your own that you arc 
sure will give you a feeling of success? 
20. Do you wonder whether people like and respect you? 
21. Do you feel unsure of yourself because of your looks and appear- 


30. 


91. 


32. 


33. 


24. Are you sure you know 


+ In general, do you feel 


- Do you think that your looks and 


ances? 


‚ On the whole, does life tend to be happy or unhappy for уои? 


j. Do you feel left out of the groups you go with? 


what you most want out of life? 


+ Does the work you do bring out your best talents and abilities, 


and give you a chance to try out ideas of your own? 


- Do the people you go with look 


up to you for what you know 
and understand? 


as healthy as the people you go with, or 


not? 


appearances are likely to hold 
you back in the future? 


. Have you done anything outside of work that someone you 


admire has thought worth while? 


Do you feel sure that the people you go with accept you as a 
social equal, or do you wonder about that? 


Do you think your social background has tended to 


t help you or 
to stand in the way of your getting ahead? 


Are you more bothered about 


sexual matters than the people 
you go with seem to be? 


As far as your health in general is 


concerned, does the future 
look very good, fair, or poor? 


= Satisfied 
——Dissatisfied 
Don't know 


—Yes 
=— No 
— —— Don't know 


Yes 
EX NIS 
-—— Don't know 


— Yes 
———No 
—  — Don't know 


— —— Yes 
—— No 
— Don't know 


— ——Happy 
— ——Unhappy 
— —— Don't know 


— Yes 
— Nü 
— Don't know 


Yes 
———No 
— Don't know 


— Yes 
No 
— Don't know 


Yes 
No 
— —— Don't know 


— Feel as healthy | 
— —— Do not feel as healthy 


— ——Don't know 


Yes 
———No 
Don't know 


— ——Yes 
— ——No 
Don't know 


— —— Feel sure 


— — — Wonder about it 


Don't know 


—  — Tended to help X 
— — —'Tended to stand in 


— Don't know 


— Yes 
— No 
—— Don't know 


Very good 
— —— Fair 
Poor 


a 


2° 


go 
a 


36. 


37. 


38. 


39. 


40. 


r 


- Do the people you work with апу 


* What do you think people need to fec 


PERSONAL SECURITY 


о xi 
. Do the people you go with give you credit and recognition for 


what you do, or do they fail to do this? 

9 
for give you credit and recog- 
nition for what you do, or do they fail to do this? 


Do you feel unsure of yourself because of your health? 


Do you feel as successful as the people you go with in the things 


you do outside of work? 


When it comes to getting along with members of the opposite 
sex, do you feel sure of yourself, or unsure of yourself? 


e in this area, that is in getting 
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Give credit 
Fail to give credit 
Don't know 


Give credit 
Fail to give credit 
Don't know 


Yes 
No 
Don't know 


— —— As successful 
Not as successful 
Don't know 


Sure 
Unsure 
Don't know 


Very good 


Would you say that the futur t т 
along with members of the opposite sex, looks very good, fair, or — ——Fair 
poor? Poor 
3 j 
Are you bothered by wanting to do things you do not feel men- =—=® 
No 


tally or intellectually able to do? 


feling you "belong?" 


Part Ш 


] most secure? 


Don't know 


- Do you feel satisfied or dissatisfied with your present social stand- — Satisfied 
ing? » — — —Dissatisfied 
Don't know 
- Do you think that looks and appearances help to keep you from D 


Don't know 


31 


* What do you think makes people feel most ins 
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СНАРТЕК I 
INTRODUCTION" 


C ONSIDERABLE importance has been at- 
- tached to projective techniques by 
clinical psychologists and professional 
personnel in allied fields. Such devices 
have, been used in psychiatric diagnosis, 
academic and industrial selection, edu- 
cational and vocational guidance, re- 
Search studies of personality develop- 
ment, and in psychotherapy. One of the 
outstanding problems with respect to 
such techniques is their validity in their 
Various applications. 


me, wish to acknowledge my indebtedness to all 
jm шшк who helped to make this study possi- 
Well kan especially grateful to Professor E. Lo- 
with elly for his counsel, instruction, and labor, 
the out stint, Such value as may be derived from 
to } study must, for the most part, be attributed 
Dr bor Lam indebted to Dr. Donald G. Marquis, 
Wm. corge A. Satter, Dr. Max L. Hutt, and Dr. 
critici Clark Trow for their suggestions and 
Etna and to Dr. Donald W. Fiske and Dr. 
ele C. Tupes for their willing help: My vile, 
and, fi was, as always, inspiring and stimulating, 
with di addition, labored long and arduously 

ied data, Caroline Weichlein and Phyllis “| 
chores, Were most zealous with the secretaria 
ean opinions expressed herein are the a 

еге: © not necessarily reflect the views 

rans Administration. 


uthor's 
of the 


A review of the literature on projec- 
tion techniques emphasizes the need for 
determining the extent to which projec- 
tive techniques agree with independent 
criteria in the description of personality. 
We may have different kinds of validi- 
ties depending upon the function pro- 
jective techniques are asked to serve. 

The purpose of the present investiga- 
tion is to continue the study of the valid- 
ity of projective techniques by consid- 
ering the following questions: 


(1) How well are projective clinicians 
who use the same projective meth- 
od able to describe personality? 
Are there differences among clini- 
cians in this ability? 

(2) Are there differences in the extent 
to which personality is correctly 
described which are related to the 
kind of projective method used? 

(3) Are there differences among attri- 
putes of personality which make 
for differences in the degree to 
which they can be correctly de- 


scribed? 


CHAPTER II 


PROCEDURES AND METHODS 


HE present investigation was done as 
Га of the research project оп the 
Selection of Clinical Psychologists spon- 
sored by the Veterans Administration 
under a contract with the University of 
Michigan, under the direction of Profes- 
sor E. Lowell Kelly (3, 4). 


A. THE ASSESSMENT PROGRAM 


During the Summer of 1947, 140 stu- 
dents who had been selected by univer- 
sities for first-year positions in the Veter- 
ans Administration clinical psychology 
training program came to Ann Arbor 
in "classes" of 24 per weck to be as- 
sessed. During the assessment week a stu- 
dent completed a battery of paper and 
pencil objective tests, and had adminis- 
tered to him in group form the The- 
matic Apperception Test (10 cards) and 
the project's form of a sentence comple- 
tion test. During the first day or two the 
student was administered the Rorschach 
and the Bender-Gestalt individually arid 
at separate sessions. Each student was in- 
terviewed twice (6), filled out a 131-item 
Biographical Inventory, wrote an autobi- 
ography, was put through a variety of 
situations, and filled out a sociometric 
questionnaire. 

The subjects, on whom the ratings in- 
vestigated in this study were made, con- 
sisted of 128 male college graduates who 
had been accepted by various universi- 
ties for graduate training in clinical psy- 
chology. The twelve women who were 
part of the total assessed group have 
been omitted from this study. 

Because they are crucial to the present 
study, a detailed discussion is given to 
the rating scales, the projective ratings, 
and the criterion ratings. 


B. THe RATING SCALES 

Thé rating scales cover 42 variables di- 
vided into three sections which are 
given the letter designations A, B, and G 
Scale A, consisting of 22 variables, was 
designed to describe more overt a P" 
notypical dimensions of personality E 
was adapted from Cattell’s (1) factoria 
studies, with modifications made on = 
basis of experience with the scale С 
earlier pilot assessments. In the presen 
study 5 of the 22 Scale A variables d 
used. These 5 were selected on the c 
of a factorial analysis by Fiske (2). Bp 
of these 5 selected Scale A variables has 
highest factor loadings for Fiske's five 
factors which are nearly orthogonal m 
each other. These 5 selected variables 
are: 

# 4 Depressed-Cheerful : 

#17 Conscientious-Not Conscientious 

#18 Imaginative-Unimaginative mem 

#21 Dependent Minded-Independent Mint 


Eo x «pression- 
#22 Limited overt emotional expres 
Marked overt emotional expression 


The definitions of Scale A variables 
were designed to depict these variables Д 
sharply as possible as surface емш. 
i.e., how the individual would appear © 1 
rectly to the observer. 

The g Scale B variables were des J 
to provide opportunity for judgment ie 
the more covert, genotypical, уйш. А 
or interpretive aspects of personali 
Despite the known intercorrelations °° 
tween the Scale B variables (from te 
to .79) all 9 have been used in this st" А 
since it is in the description of. pon 
aspects of personality that project 


igned 


-sonality 
‘Complete definitions of all 42 pe n by 
traits may be found in a doctoral dissert? 
Samuels (5, Appendix A). 
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techniques are commoniy thought to be 
most useful. These 9 Scale В variables 
are: о 

#23 Social Adjustment б 

#4 Appropriateness of Emotional Expression 

#25 Characteristic Intensity of Inner Emo- 

tional Tension 
6 Sexual Adjustment 
7 Motivation for Professional Status 
8 Motivation for Scientific Understanding 

of People 

#29 Insight into Others 

#30 Insight into Himself 

#31 Quality of Intellectual Accomplishments 

Scale C included 11 variables on which 
staff members were asked to make predic- 
tive judgment. ОЁ these, only number 
42, “Over-all Suitability for Clinical Psy- 
chology,” is used here, since this was the 
variable toward which the entire assess- 
ment program was oriented. Through- 
out the remainder of the discussion Vari- 
able 42 is treated as though it were a 
Scale B variable for simplification in sta- 
Ustical summary. This assumes that the 
rating on “Over-all Suitability” repre- 
sents an inference about a covert, al- 
nely complex, di- 


though perhaps extren 
and is essentially 


mension of personality 
similar to Scale B variables. 

АП ratings were made on an 8-point 
Scale^with a theoretical distribution of 
ratings of 3, 7, 15, 25» 25» 15» 7, and 3 
Per cent for points from 1 to 8 respec 
tively, Raters were instructed to use à 
reference population of first-year clini- 
cal psychology eraduate students in 
American un versies: 


C. Tur ProjecTIVE RATINGS 
As was stated above, during the early 
Part of the week each student was ex- 
amined with the Rorschach and the 
Bender-Gestalt individually. Each rec- 
ord was scored, interpreted, summarized, 
and the applicant rated on the scales 
described above by the test administra- 


tor, without other knowledge about the 
individual than could. be gained from 
the particular projective technique and 
the personal contact involved during the 
testing period. The Thematic Appercep- 
tion Test and the project form of a 
sentence-completion test were adminis- 
tered as group tests. Each subject was 
then rated on each variable of Scale A 
and Scale B by four different staff mem- 
bers, each rater basing his ratings on a 
different projective technique. A single 
staff member was concerned with only 
one projective method per subject and 
was instructed to keep himself in ignor- 
ance of the findings of the other staff 
members for that subject. After each of 
the four projective techniques had been 
independently analyzed and subjects 
rated on the basis of each, the Rorschach 
analyst, serving in a new role of “pro- 
jective integrator,” made another set of 
ratings on each variable of Scale B based 
on all the projective data, with the ex- 
ception of the actual ratings which had 
been independently made on the basis 
of each projective technique. 

The number of students seen by a 
as not the same for a 


given clinician м 
was the number of 


given technique, nor 
students seen by а given clinician the 
same, necessarily, for two or more tech- 
niques. The number of students per 
rater per technique is shown in Table 1. 

A given rater may have analyzed more 
Rorschachs than another, fewer TAT's 
than any or all of the others, and some 
other number of SC's. The differences in 
N between the two Scales, A and B, are 
table to the fact that cases which 


attribu cases WA 
“projective inte- 


were integrated by the 
' were not rated on Scale A by the 


grator" 
“projective integrator” nor by the other 
projective-technique raters. The projec- 


tive raters used in this study are fewer 
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TABLE 1 


Rater 
Techni 
кР ad w o Т Е T ‘Ge R о м Р 
Scale A 
Rorschach тї II 12 то 5 9 
ТАТ 7 8 9 5 $* T 
EC 4 8 14 4 13 2 _ d 
BG 19 14 15 
Scale B 
Rorschach 18 23 22 22 20 20 
TAT 22 22 14 28 4 25 
SOT. 16 13 37 26 6 43 
BG 32 29 33 EM. 


* With an N of three, r is either indeterminate 


** With an N of two, r is .oo or 1.00. 


in number than the total number of 
projectivists on the assessment staff. Only 
six are used, each of whom rated enough 
students via Rorschach, Thematic Ap- 
perception Test, and sentence comple- 
tion to make comparisons among them 
. possible. Four other projective raters 
were concerned only with the Bender- 
Gestalt. The latter four, coded by letters 
R, Q, M, and P, were graduate students 
at the University of Michigan, at the 
third-year level of training in the VA 
training program for clinical psychol- 
ogists, and had been trained in the clini- 
cal use of the Bender-Gestalt by the same 
instructor. The other projectivists are 
coded W, O, L, F, T, and G. They were 
initially selected on the basis of profes- 
sional competence, and the choice of an- 
other group of projective-analysis raters 
similarly selected would probably not 
have resulted in any better interpretation 
of the projective tests. The sampling of 
techniques and the sampling of variables 
are both regarded as adequate. Raters 
were given full freedom with respect to 
scoring, interpretation, and report writ- 
ing. The only formal imposition placed 


or fluctuates widely. 


upon them was the conversion of ocu 
sions, deductions, inferences, or mr 
sions into single numbers on each of th 
rated variables. қ 
Although students were assigned йү 
domly for projective examination, it W33 
possible that the relatively small am 
of students seen by a given project" s 
using one of the projective devices miga 
have represented a different a er 
population from that seen by a 
projective rater using the same pray о 
tive instrument. That is, differences 
tween projectivists' ratings might Life 
found which might be attributable to © 4 
ferences in the students examined et 
not to differences in the projective P 
niques. As an additional check on ү 
random assignment of students for me 
jective testing the following test " Е 
made, Distributions of the FinP € 
on students on Variable 42, “OV 


oen. ately for" 
Suitability,” were made separa 


ds iques 
each of the four projective techniq ue 


; s : пі 
used in this study. For a given techn!d 


à as an 
*Final Pooled Ratings. PI will be nde I 
рет m a 
abbreviation for the Projective Integrato 

Projective Integration. 
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these ratings for studeats were distrib- 
uted for each of the projective raters. 
In this way it was possible tg compare 
the mean FinP ratings on Variable 42 
with respect to the student population 
Seen by each of the projectivists for each 
of the projective techniques. Epsilon 
square was computed and no significant 
differences were found among the mean 
ratings for students assigned to different 
projective raters using the same tech- 
nique. Since the students had been ran- 
domly assigned for projective testing and 
since no differences were found between 
students for Variable 42, there was no 
reason to believe that systematic differ- 
ences would be found between students 
on other variables, and no other tests 
were made. 


D. THe CRITERION RATINGS 


In the seven-day period of each stu- 
dent’s assessment, three staff members 
rated’ the student at frequent intervals. 
A given staff member would receive cer- 
tain data on a student and rate, then 
receive other data and rate again, having 
filed away his previous ratings, and con- 
tinue to make independent ratings based 
On various kinds of data. The first team 


conference (Preliminary Pooling Con- 
ference) produced a single set of ratings 
on of the 


which represented a combinati 
judgments of the staff team based on 
these materials: objective and projective 
tests, credentials, autobiography and Bi- 
ographical Inventory, and the informa- 
Поп obtained by way of the interview 
(6). At the final pooling conference, all 
previous material and all previous rat 
ings were made available to the staff 
team. Also available at this time were 
the student's self-ratings, ratings of each 
Student by the other three members of 


the student team, che separate ratings 
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based on projective methods, and the 
ratings made by a team of staff members 
who had observed the student in situa- 
tion tests with no other knowledge about 
him. A separate final pooled rating was 
made on each variable of Scale A and of 
Scale B. These ratings are regarded as 
the best available measures of each of the 
42 personality traits for each subject as- 
sessed, and are the criterion measures of 
this study. They are designated FinP. 
The FinP ratings are the most com- 
prehensive and inclusive ratings to come 
out of the entire week's assessment. 
These ratings were made by different 
combinations of three staff members. 
The staff were initially selected on the 
basis of professional competence. They 
had had opportunity to study the stu- 
dent in a wide variety of ways, and had 
had the benefit of judgments of many 
oter skilled clinicians at various points. 
Although they are admittedly fallible, 
there can be little doubt that these FinP 
raings are as valid criterion measures of 
these variables as are obtainable at the 
present time from skilled clinicians using 


present techniques in an assessment situ- 


ation. 
The FinP ratings are composite cri- 


teria consisting of the pooled judgments 
of three staff members who had available 
to them the results of the tests and pro- 
cedures indicated above. A separate FinP 
rating was made for each variable of 
Scale A and Scale B. Since staff members 

their final judg- 


were free to arrive at 
ments as they chose, it would be difficult 


hether FinP ratings emphasized 
abilities, capacities, past achievement, or 
personality characteristics. Of interest in 
this connection is 5... the fact that as- 
sessment staff members tended to be uni- 
formly of the opinion that the interview 
uted most to their ‘understanding 


to say W 


contrib 
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of the case,’ followed by either the pro- 
jective tests or autobiography” (4, р. 
404). 

Two problems must be considered 
with respect to the relationship between 
the ratings based on projective tech- 
niques and the FinP ratings. First, how 
much influence did any or all of the 
projective techniques have on the cri- 
terion measures? Second, are there differ- 
ences in the criterion ratings when the 
Projective Integrator is and is not a 
member of the criterion team? 

With respect to the first problem of 
the influence of projective techniques on 
criterion measures, a quantitative answer 
cannot be given. The projective tech- 
nique protocols and the ratings based on 
them were available to the final pooling 
team. This constitutes a theoretical 
defect in the design of this study which 
Was a sacrifice which had to be made in 
consideration of other aspects of the 
overall project design. It would have 
been preferable, of course, if the ratings 
based on each projective technique could 
have been checked against a criterion 
based on all available data except that 
technique. This deficiency with respect 
to experimental independence would 
have the effect of spuriously raising the 
correlations between the ratings based 
оп projective techniques and the cri- 
terion. The possible effect of dominance 
in criterion ratings by any one criterion 
team member tended to be cancelled by 
the rotation of staff members from weck 
to week in such a way that for each of 
the student classes the criterion teams 
were differently constituted. This does 
not eliminate the possibility of what 
might be called group bias with respect 


to projective methods, For example, 


many of the staff members, not them- 
selves projectivists, spoke very respect- 
fully of the value of the Rorschach and 
may have given careful attention to the 
Rorschacii ratings in arriving at the cri- 
terion ratings. The possibility exists that 
another staff, or the same staff assessing 
at another time, might have another F 
titude toward projective methods gae 
arrive at a different set of criterion ж, 
for the same subjects. Since there is smal 
likelihood of another asse ment. de 
signed to measure the reliability of cri- 
terion ratings by the test-retest regli: 
nique, these obtained criterion menr d 
must be regarded as the only ones sind 
able, and therefore, in a practical sense, 
as universe (not sample) measures. " 
The problem of the effect of the A: 
jective Integrator as a criterion red 
member on the criterion team ratings 
can be evaluated. The Projective ШЕ 
grator was a member of the criterion 
team for half the number of jus 
Since the Projective Integrator was alee 
the Rorschach analyst, it might be mA 
pothesized that if he exerted a re 
influence on the criterion ratings 1n ек 
direction of his Rorschach ratings, gher 
the correlations between ratings based л 
Rorschach and criterion ratings wou E 
be higher when the Projector Integra 
was a member of the criterion team oe 
they would when he was not. A compa" h 
son of correlations between Rote 
ratings and FinP ratings when the Pr : 
jective Integrator was and was not | 
member of the criterion ae 
none of the differences between cone нн 
tion coefficients under these Lag gp 
to be significant at the .o5 level, : 
was the direction of difference consis 


team 


tent. 
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CHAPTER III 


RESULTS 


о 

A. THE PROJECTIVE Trcutiques 

1. Validities of ratings based on 

projective techniques 

T DETERMINE the extent to which 
1 ratings based оп projective tech- 
niques correlated with FinP ratings, the 
ratings made by the six raters (four in 
the case of the Bender-Gestalt) were en- 
tered into a single scatter plot for each 
technique and variable. It was found 
that something other than “chance” 
Operated to generate statistically signifi- 
cale A vari- 


cant correlations, since, for S 
ables, only 1 correlation in 20 was ex- 
pected to be significant at the .05 level by 
chance and we find 9 in 20 significant at 
this level. With respect to Scale B, where 
{0 correlations were computed, we would 
expect 2 to reach the .o5 level and we 
find 30 of the до correlations are signifi- 
cant at this level. In addition it was 
of the бо coefficients 
o findings, the 
of statistically 


noted that only 2 
were negative. These tw 
relatively large number 
significant correlations and the high pro- 
Portion of positive correlations, suggest 
that the ratings based on projective tech- 
nique; have some validity. However, 
these results are, to some extent, spurious 
Since, in addition to the fact that the 


correlations among Scale B variables were 
more often positive than negative, and 
fairly high. 

The median correlation coefficients be- 
tween ratings based on each of four pro- 
jective techniques and FinP ratings are 
presented in Table 2. It was noted that 
correcting the technique-FinP »'s for at- 
tenuation in the FinP ratings raised the 
median r only slightly, the greatest in- 
crease being from .31 to .35 in the case of 
the SC on Scale A. That is to say, that 
even had the FinP ratings been perfectly 
reliable, the ratings based on projective 
techniques would have correlated only 
slightly higher with the FinP ratings. 


2. Differences in the validities of ratings 

?among the projective techniques. 

In order to test the hypothesis that 
there are no differences in the validities 
of ratings made on the basis of the four 
techniques used in this study the follow- 
ing analysis was made. The validity co- 
efficients for each of the techniques for 
each of the 15 variables were transformed 
into Fisher's z function and analysis of 
variance was done for each of the two 
sets of variables. There was no rater vari- 
ance here since raters had been com- 
bined for each technique. The results of 


the analysis of variance for the trans- 


Criterion measures by the six raters were i 
not completely independent, the inter- formed validity coeficients for tech- 
TABLE 2 
" кини 
MEDIANS or CORRELATIONS BETWEEN RariNGs BASED ON Eacu oF Four PROJECTIVE 
TECHNIQUES AND FINAL PooLED RATINGS FOR ScALE A AND SCALE B VARIABLES 
| Technique 
Scale E » 
Ror. n TAT n SG n BG Я 
Scale А a 38 .32 56 ES 45 A 61 
Scale B ү 125 26 115 .28 102 xd 127 
Both Scales .27 E .28 .19 
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niques for Scale A showed no significant 
differences in validity at the .o5 level for 
the techniques or for the variables. The 
analysis of variance of the Scale B vari- 
ables showed no significant differences 
between variables but a difference be- 
tween techniques significant at the .o1 
level. Further analysis showed that this 
difference was attributable to the ratings 
based on the Bender-Gestalt; this tech- 
nique differed significantly from each of 
the other three techniques which did not 
differ significantly among themselves. 
Since the Bender-Gestalt raters were four 
different people from those whose ratings 
were based on the other three techniques, 
conclusions from these findings must be 
made with great care. 


3. Comparison of technique validities on 
Scales A and B 


When the median validity coefficients, 
which are given in Table 2, are ex- 
amined, one is struck by the fact that 
with the exception of the Rorschach the 
coefficients are somewhat higher for Scale 
A, which is not a result that might have 
been readily hypothesized beforehand. It 
may also be noted that while many of 
the median values are Statistically signif- 
icant (.05 level) none of them may rea- 
sonably be regarded as predictively use- 
ful. Thus, for the techniques studied 
(with the exception of the Rorschach), 
we see that projective methods do not 
lead to more valid inferences about the 
more presumably covert aspects of per- 
sonality, as is frequently argued, than 
they do of the more obvious aspects of 
personality. On the other band, and par- 
ticularly with reference to the TAT and 
the SC where the student was not seen 
by the rater (Ror and B-G were admin- 
istered by the rater) and behaviorial 
manifestations of the student were in- 


SAMUELS 


ferred from the ‘protocol only, we find 
that ratings are as valid, by and large 
for overt variables as for covert variables. 
The possibility that these findings may 
have been related to the unreliability of 
the criterion ratings has been shown to 
be dismissible. Another criticism of these 
findings may ask if it is fair to require 
clinicians (in this instance projective 
clinicians) to express their impressions 
and judgments in the form of ratings 
The core of the argument is that clink 
cians are accustomed to describing ther 
findings in the form of language (Gine 
pretive findings beyond the scores, ratios, 
percentages, etc. required by the various 
test instruments) and not in the form o 
ratings. While this problem must, ре” 
haps necessarily, remain largely a matter 
for individual judgment, there is COT" 
siderable merit in the argument that 
numbers may be more precise than 
words, and are definitely far more usefu 
in the verification of hypotheses. This 
position does not deny the possibility 
that ratings may not accurately represen 
the judgments about people which a 
cians can make from personality pe 
data, nor does it deny the possibility - 
such judgments may be more accurate | 
communicated in some form other tha? 
ratings. p 
That there are not more differences m 
validities between the two scales for бе 
projective techniques is a curious finding 
and difficult to understand. It is not Ж 
reasonable to believe that if one im 
understanding of the dynamics о ке 
havior опе can infer опе step тоге : but 
overt behavior of a given individual; ер 
іп making the additional inferential $ or- 
there is additional opportunity for sis 
It would not have been surprising t° har- 
that ratings of overt personality С h 
acteristics had less relationship (0 


тете 
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criterion ratings than ratings of the co- 
vert traits. That they do not—and since in 
both cases the relationships with the cri- 
terion ratings are low—sugges's further 
study to determine, for example, how 
much correlation there is between the 
criterion measures and ratings based on 
observations of the subject in the pro- 
jective testing situation, and how much 
with ratings based on projective data 
without direct observation of the subject. 


4. Correlations between projective 
technique ratings 
Up to this point the four projective 
techniques have been considered as ge- 
nerically related. They have been called 
by a class name and regarded as methods 
of evaluating personality characteristics. 


We have found that ratings based on 
each of the four techniques show but low 
correlation with the criterion measures. 
We shall turn to the question, to what 
degree are personality ratings based on 
each of the separate techniques in agree- 
ment? This was investigated by inter- 
correlating the ratings, variable by vari- 
able, for each of the four techniques. The 
results are shown in Table 3. While there 
is a tendency toward positive relation- 
ships (101 out of 120) among the inde- 
pendent ratings (no two ratings of a 
single subject on a given trait were made 
by the same projective technique rater), 
there is very little basis for a feeling of 
confidence that these instruments serve 
similar functions, ie. that these instru- 
ment-clinician combinations are measur- 


TABLE 3 
© 
CORRELATIONS BETWEEN RATINGS BasED ON EACH OF THE PROJECTIVE TECHNIQUES* 
‘ Scale A 
Varia - 
apes Ror/TAT Ror/SC Ror/BG TAT/SC TAT/BG SC/BG 
.o8 .o8 — .05 лі +14 
5 Em —.o1 жї 09 -13 EIL 
18 E .21 ло .23 .об 109 
21 —.20 .22 .o6 .05 „хо —.02 
22 Bry —.ог ET 246. 03 i 
Scale B 
Vari 
E. Ror/TAT Ror/SC Ror/BG TAT/SC TAT/BG SC/BG ру 
К: 14 —.07 -04 .04 
54 са pos —.04 ‚оо .06 —.02 
2 =a 03 ої = .05 -02 Єй 
28 ‘08 +00 11 14 .05 ES 
27 її .o8 —.09 ‚14 .05 216 
28 І .02 .07 .04 13 то 
29 d .05 .16 Ж. .07 E: 
3o lo .o8 .09 +09 .09 о! 
3r "s 13 .07 .o6 234. 8 
= as .22 .o6 —.o$ ло aL 
Scale Median correlation for 
Scale A .o8 ло -09 ло .04 
Scale B dt .o6 —.02 -25 a "e 
Both Scales .05 .05 .o6 A ү 


6 * Correlation coefficients which аге underl 
т. For Scale В, N equals 128. 


ined are significant at the .o. 


5 level. For Scale A, N equals 
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TABLE 4 


MEDIANS or CORRELATIONS BETWEEN 


Projective TECHNIQUE RATINGS AND FINAL* 


PooLep RATINGS For EACH or Six PROJECTIVE RATERS 
Rorschach. 
Median correlation for А 
Scale ——- x i RR 
W m O m L m Е n I n G #2 All 
Scale A .26 І ло II .05 12 .16 10 5 43 9 24 
Scale B .30 18 +21 23 .26 22 244 22 20 20 20 `3 
Both Scales +30 +21 +22 44 3o “19 
TAT 
Median correlation for — 
Scale — = =] 
W n о п L.s3 F n I n К „з=... 
Scale A quo; 33 8 37 9 30 15 == 3 о 14 б 
Scale В .26 22 .16 22 222 І 244 28 406 4 “23 125 аз 
Both Scales .28 .21 .26 40 Е 25 3° 
SC 
Median correlation for а 
Scale - —— — ma = - ЕТ 
W m O m L nm F n T n G n 2 UEM 
Scale A nc MET 154 8 a8 ча .82 4 = 2 EH 
Scale B -04 16 -36 13 252 37 бо 4 фо 6 8° 
Both Scales .04 -47 .3o 74 à 43 


*Correlation coefficients which are underlined are significant at the -05 level. 


ing the same thing. Although the propor- 
tion of positive correlations is large, only 
9 correlations out of 120 are significant at 
the .05 level, where 6 correlations are ex- 
pected to reach this level by chance. 


B. Tue Proyecrive RATERS 
1. Relative validities of ratings for 
individual raters 


Beyond the techniques per se we are 
interested in the relative validities of the 
individual raters by technique and by 


variable. In "Table 4 may be found the 
median validity coefficients for all traits 
in Scale A and Scale B respectively, and 
for both Scales together. These are the 
median correlations for each of the six 
raters for ratings based on the Rorsclzach, 
TAT, and SC, respectively. Table 5 con- 
tains the same information for the Ben- 
der-Gestalt. 

The results obtained (of which only 
the medians are presented here) suggest 
that two of the six Rorschach analysts 


TABLE 5 


MEDIANS OF ConRELATIONS BETWEEN BENDE 
RATINGS For EACH or Four 


R-GESTALT RATINGS AND FINAL POOLED 
BENDER-GESTALT RATERS 


Rater 
Scale 

R n Q n M n P n All = 
Scale A 23 19 оо 14 27 15 o 1 +25 
Scale B 14 32 ло 29 22 3: E 31 Er 
Both Scales 14 ло .26 à 6 x Am 


j! 
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were able to make ratings which cor- 
related with the criterion ratings beyond 
chance expectancy at the .o3) level. For 
these two raters, Е and T, (е median 
coefficients for Scale B are, respectively, 
44 and .48. These are the only median 
coefficients which are statistically signifi- 
cant for the six raters on both scales. 
The number of statistically signifi- 
UE individual (not median) correla- 
tons is, considering both scales, greater 
than would be expected in chance occur- 
rence for any rater, since at the .05 level 
only one in twenty coefficients is ex- 
pected to reach this level by chance. The 
median value, however, is regarded as 
a better representation of the validity of 
à rater, in that it allows for the fact of 
intercorrelation between the traits within 
each Scale. 

While the evaluation of a correlation 
coefficient in terms of what may be called 
its social significance is quite subjective, 
there is little reason for enthusiasm to- 
Ward the efficiency with which these six 
Rorschach analysts were able to predict 
the criterion ratings. Although the valid- 
ity coefficients for Rorschach raters may 
seem somewhat discouraging, it is em- 
phasized that the ratings of Rorschach 
projectivists Е and Т appear to be rea- 
sonably valid. This finding is congruent 
With the situation which exists in the 
area of projective testing in which, to а 
very considerable extent, adeptness in 
the use of projective methods is acquired 
through instruction by masters. In the 
Practical situation of assessment, how- 
Sver, four of the six Rorschach raters, 
initially selected on the basis of clinical 
Competence, did not make as valid rat- 
ings as the other two. The high propor- 
tion of positive correlations suggests that, 
“niler assessment conditions, the Ror- 
schach method provides a basis for some 


validity of rating. 

These findings and observations also 
apply, in general, to the data obtained 
for raters using the TAT, SC, and BG. 


C. RELATIVE CONTRIBUTIONS OF RATERS, 
TECHNIQUES, AND TRAITS TO VALIDITIES 
ОЕ RATINGS 


In order to determine the relative con- 
tributions of each of the three sources of 
variance investigated in this study to the 
validities of ratings, the following analy- 
sis was carried out. The validity coeffi- 
cients were regarded as scores, and, after 
being transformed into their respective z 
functions, were treated by the method of 
analysis of variance. Analyses were done 
separately for Scales A and B, and addi- 
tional analyses for the Bender-Gestalt. 

For Scale A traits the results indicated 
that significant. differences in validity 
may be attributed both to techniques 
and to raters (.05 level) and that the in- 
teraction of techniques and raters makes 
for differences in validity (о: level). 
That is to say, that for Scale A traits, the 
waits themselves do not contribute sig- 
nificantly to differences in validity. How- 
ever, the different techniques make for 
differences in the validity of ratings and 
the different raters make for differences 
in validity of ratings. We find differences 
in validity dependent upon who rates, 
and upon what technique is being used, 
and differences in validity for the com- 
binations of raters and techniques. 

A similar analysis of Scale B traits 
showed significant differences in the 
ratings for technique-rater 
analysis, however, 
argely the 


validity of 
combinations. Further 
showed this difference to be 1 
ater differences in valid- 
he Scale A traits, 
a source of 


contribution of r 
ity of rating. As with t 


aits themselves are not 


the tr 
[ ratings. While 


differences in validity o 
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the techniques did contribute to differ- 
ences in rating validity for Scale A traits, 
they are not sources of difference for the 
Scale B traits. For the presumably covert 
aspects of personality it appears that dif- 
ferences in validity depend chiefly upon 
the rater. 

Separate analyses of variance for each 
of the two Scales for the Bender-Gestalt 
showed that neither variance due to 
raters nor variance due to traits was sig- 
nificantly greater than variance due to 
chance. Since only the one projective 
method was involved in these analyses, 
there was no technique variance. 

It seemed reasonable to expect that 
some personality traits would be rela- 


tively more validiy rated than others by 
one or all of the projective techniques or 
by one or a'l of the projective raters. The 
absence of statistically significant differ- 
ences in validities of ratings attributable 
to differences among traits is necessarily 
qualified in that to the extent to which 
there is correlation among traits, it is 
more difficult to find existing differences. 
This is not a particularly cogent objec 
tion in the case of the Scale A variables 
for which the intercorrelations were low. 
The Scale B traits do have, in some 1n- 
stance, sizable correlation between them, 
resulting in an underestimation of the 
significance of the between-variable vari- 
ance. 


z CHAPTER IV 


OTHER FACTORS RELATED TO VALIDITY 
& 


І N THIS chapter are presente( data with 
respect to factors, other than those 
originally considered in the scope of this 
study, which may have had an effect 
upon the validity of ratings based on 
projective techniques. Consideration will 
be given to the possibility of bias in rat- 
ing; to differences in dispersion (confi- 
dence) of ratings; to some additional fac- 
tors concerning raters; and to the possi- 
ble effects of unreliability in the predic- 
tor and criterion ratings. 


A, Bras IN RATING 


One factor which may be related to 
the validity of ratings based on projec- 
tive techniques is the frame of reference 
in which ratings were made. By frame of 
reference is meant an attitude of opti- 
mism represented by a tendency to make 
ratings in the direction of the "lauda- 
tory" or socially desirable end of the 
rating scale. It is possible that if ratings 
on a given technique tend, consistently, 
to be either more or less “Jaudatory” 
than the Final Pooled Ratings, that this 
attitude might be related to the validity 
of such ratings. Similarly, it is possible 
that such differences in attitude might be 
related to differences between the rela- 
tive validities of ratings among the tech- 
niques. In order to determine whether 
Such “frame of reference" differences did 
obtain, the following was done. First, in 
order to compare the ratings by each of 
the techniques with the FinP ratings, 
tie significance of the difference between 
the mean ratings was calculated. This 
Was done by the usual method of obtain- 
mg the quotient of the difference be- 
tween means divided by the standard 
error of the difference. In each instance 


the FinP means were subtracted from 
the technique means and the arithmetic 
sign recorded in order that the direction 
of difference be known. This procedure 
was followed for the four techniques for 
the fifteen traits studies. A comparison of 
the FinP means with those of the Projec- 
tive Integrator was necessarily limited to 
the ten Scale B traits. Second, the mean 
ratings by each of the techniques on the 
fifteen traits were compared with the 
mean ratings by each of the other projec- 
tive techniques, again by calculating the 
significance of each of the differences. 
The results of the comparison of mean 
ratings for techniques and FinP ratings 
are presented in Table 6 in the form of 
an abbreviated table of signs. Either a 
plus or a minus sign is entered in the 
table where a statistically significant (.05 
level) difference between means occurs. 
The plus sign is used to indicate that the 
technique mean was in the “laudatory” 
direction, while the minus sign indicates 
that the FinP mean was in the "lauda- 
tory" direction. An examination of 
Table 6 reveals that the number of sta- 
tistically significant differences found ex- 
ceeds the number which might have 
been expected if only chance were in- 
volved but these differences are not con- 
sistently in the same direction. In the 
e of the Projective Integrator the ob- 
tained significant differences are always 
in the direction of being less “Jauda- 
tory,” and for the Rorschach one may 
note a trend in the same direction." 
These data may be of interest insofar as 


1 Soskin (5) analyzed 
dent behavior in a se 
and found that Situat 
subjects are being ch 
by the condemnatory pole. ..- 
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ratings based only on stu- 

ries of standard situations 

ionists "see the sample of 
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” 
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TABLE 6 


TABLE OF SIGNS SHOWING STATISTICALLY SIGNIFICANT l JIFFE 
MEAN TECHNIQUE RATINGS AND MEAN FINAL Poo 


SVWEEN 


Variable Ror-FinP TAT-FinP 


Sc-FinP 


PI-FinP 


BG-FinP 


4 
17 


18 


with the technique mean іп the “laudatory” 


# The Projective Integrator did not rate S 


they characterize the PI and the Ror- 
schach as tending to look on the dark 
side of personality, but probably have 
little, if any, relation to validity. When 
the differences shown in Table 6 were 
compared with the validity coefficients 
which are statistically significant for the 
techniques and for the Projective In- 
tegrator, it was apparent that Statistically 


* In this table the “+” sign indicates that there is 


direction. The reverse is true for the " — 
cale A variables, 


[SRS sitze че HS 


РРР? 
level) 


' significant difference (o5 
sign. 


à statistic; 


significant validity coefficients were eu 
tained at least as frequently when there 
was not a difference between means 3$ 
when there was a mean difference. It may 
also be noted that statistically significan: 
validity coefficients are not consistently 
associated with differences cither n 
or away from the “laudatory” end of t! 

rating scale. 


TABLE 7 


TABLE oF ЅТАТІЅТІ 
R. 


CALLY SIGNIFICANT DIFFER 
ATINGS BASED ON EACH Or THE PROJEC 


Variable Ror-TAT Ror-SC 


Ror-BG 


4 
17 
18 


* In this table the “+” sign indic. 
with the first of the two tei 
verse is true for the “ 


—" sign. 


| ates that there is 
'chniques at the head of the 


+ 


+++! 


$ level) 


The re 


mace ie E үн о 
a Statistically significant difference C 
column in фе “аца огу” direction. 


a 


| 
| 
| 
| 


PERSONALITY-TRAIT RATINGS BASED ON PROJECTIVE TECHNIQUES 15 


In Table 7 are presented the signs of 
statistically significant differences be- 
tween the mean ratings among the tech- 
niques. In this table the minus sign indi- 
cates that the first of the не, technique 
abbreviations at the head of the column 
has a mean rating in a less “laudatory” 
direction. Thus, the minus sign for Trait 
#22 in the first column signifies that 


significant validity coefficients than the 
Bender-Gestalt without there being any 
differences between the means for these 
two techniques. Again, one might charac- 
terize the Rorschach raters as tending to 
view people darkly, while the Bender- 
Gestalt raters tend in the direction of rat- 
ing personality in а relatively benign 
fashion. 


TABLE 8 


TABLE or STATISTICALLY SIGNIFICANT DIFFE ›/ 
RATINGS AND FINAL POOLED RATINGS 


or TECHNIQUE 


:NCES BETWEEN STANDARD DEVIATIONS 


Variable 


Ror-FinP TAT-FinP 


SC-FinP BG-FinP PI-FinP 


SEBS SAH 


+ 


+ 


+ 


sign indicate 


* In this table the “+ л 1 
iving the larger st 


with the technique ratings havin 
# The Projective Integrator did not ra 


there is a significant difference between 
the mean ratings of the Rorschach and 
TAT on this trait, and that the differ- 
ence is in the direction of the Rorschach 
being less “laudatory.” The apparent 
tendency for ratings based оп the 
Bender-Gestalt to be more often in the 
“laudatory” direction than ratings based 
on the Rorschach or Sentence Comple- 
tion may suggest a relationship to dilfer- 
ences in validity, since both the Ror- 
schach and Sentence Completion yielded 
more and higher statistically significant 
validity coefficients than the Bender- 
Gestalt. This argument is weakened, how- 
ever, by the observation that the TAT 
too yielded more and higher statistically 


5 that there is a statistical à AS 
andard deviation. The reverse is true for the “—” sign. 


te Scale A variables. 


ally significant difference (.os level) 


B. DISPERSION (CONFIDENCE) OF RATINGS 

Another factor which needs to be eval- 
uated, since it might be related to valid- 
ity of ratings, is the spread of scores or 
ratings. When there is more spread, the 
likelihood of obtaining higher correla- 
tion coefficients is increased. If one is 
willing to assume that where a rater 
lacks confidence in his rating he will 
tend to rate closer to the mean than he 
will when he does feel confident, then we 
can use a measure of spread as an index 
of confidence in evaluating confidence in 
rating as a factor in validity. 

Table 8 is a table of signs showing 
where significant differences in spread 
(standard deviation) occur. A plus sign 
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TABLE 9 


TABLE ОЕ STATISTICALLY SIGNIFICANT DIFFERENCES BETW 


STANDARD DEVIATIONS 


OF RATINGS ON EACH Or THE PROJECTIVE TECHNIQUES* 


Variable Ror-TAT Ror-SC 


Ror-BG 


TAT-SC TAT-BG SC-BG 


4 

17 E 

18 + 
21 

22 

23 

24 + 


31 + 
42 + + 


$ ыб = 
— 


. * E. 3 H аР" ере " È z vel 
* In this table the “+” sign indicates that there is a statistically significant difference соз муб 
with the first of the two techniques at the head of the column having the larger standard devia 


he reverse is true for the “—” sign. 


indicates that the spread for the tech- 
nique ratings is significantly greater than 
that for the FinP ratings, and vice versa 
for the minus sign. These data suggest 
that dispersion of ratings has little or 
no relation to validity. The ratings based 
on the Bender-Gestalt, which are the 
least valid of the four sets Of ratings, 
most often show significantly greater 
spread than the Finp ratings whereas 
the Projective Integration ratings, which 
are more valid for more traits than the 
ratings based on the Bender-Gestalt, are 
in no instance Significantly different in 
Spread from the FinP ratings. It is inter- 
esting to note that ratings based on each 
of the four projective techniques (but 
not the Projective Integration) have sig- 
nificantly Jarger standard deviations on 
Trait #25, “Characteristic Intensity of 
Inner Emotional Tension,” than the 
FinP. If this represents a feeling of con- 
fidence, it appears not to be justified con- 
sistently since the TAT and BG ratings 
on this trait did not correlate significantly 
with the criterion ratings. 

A comparison of the techniques with 


each other in terms of willingness to 
spread ratings was carried out. The re- 
sults are presented in Table 9. The data 
suggest that ratings based on the Ror- 
schach tend to be made with more spread 
than those based on the Sentence со 
pletion and ТАТ. Similarly, the ae 
Gestalt tends to inspire dispersion 
ratings at least equal to the Rorschac я 
This may be а function of the fact vi 
both the Ror and BG were administerec 
by the rater; i.e., face to face contactmay 
be related to dispersion of ratings em 
fidence). This would be consistent. wit? 
the staffs opinion that the ие 
contributed most to their understanding 
of the case. 


C. ADDITIONAL Factors CONCERNING 

ў RATERS 

It has been shown, (Chapter ІП, В, Fs 
that different raters contribute signi J 
cantly to differences in validities of ve 
ings. One possible explanation wh n 
finding, that "good" raters may p 
been assigned to one technique m 
"poor" saters to anocher, is not too 


E 


"X 


bI 
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able since all the projective raters used 
the same techniques (except for the Ben- 
der-Gestalt) and, in addition, cases were 
randomly assigned to raters. On the other 
hand the number of cases seen by each 
projective rater varied and the obtained 
difference in validities for raters may 
have been related to difference in size of 
samples. As a way of evaluating whether 
there are differences in validity associ- 
ated with the numbers of cases seen by 
"good" and "poor" raters, the rank-order 
positions of raters was used as an index 
of ability to rate. If we consider that 
those raters in the upper half of the rank- 
ing are "good" raters and those in the 
lower half are "poor" raters, then for 
Scale B, we find the following. For the 
Rorschach the "good" raters W, F, and 
T, saw 65 of a total of 125 cases; for the 
TAT the “good” raters, W, F, and T, 
saw 54 of the 115 cases; for the SC the 
“good” raters, F, T, and G, saw 36 of 102 
cases. Also, the size of the median valid- 
ity coefficient for the SC compares favor- 
ably with those of the Rorschach and 
TAT. We may conclude that the size of 
Sample for different raters is not signifi- 
cantly related to validity of rating. 

Another possibility to be considered is 
the effect of a given projective technique 
On a rater. There may be something in 
the nature of a given technique which 
effects a change in the clinician who uses 
it. The data in Table 6 suggest that the 
Rorschach is more often associated with 
а tendency to see people in a less benign 
light than are the other techniques. 
When the Rorschach rater in his role of 
Projective Integrator makes a new set 
of ratings, incorporating the results of 
the other projective techniques with his 
own Rorschach results, this tendency to 
See people in a less benign light is in- 
creased, 


D. FURTHER EVIDENCE ON INTER-JUDGE 

AND INTER-TECHNIQUE AGREEMENT 

As was reported in Chapter IA 535 
this study found that unreliability of cri- 
terion ratings has very little effect on the 
validity of ratings based on projective 
techniques. There is no way of knowing, 
from the present data, to what extent the 
low validities found are a function of the 
unreliability of raters. The question may 
be asked in two ways: to what degree do 
judges agree when they use the same 
technique, to what degree does a judge 
agree with himself using different tech- 
niques? In order to answer these ques- 
tions another study was carried out and 
some preliminary results were available 
at the time of writing. In this new study 
four projectivists made ratings based on 
each of four projective technique rec- 
ords from each of a total of 20 sub- 
jects. The number of subjects and raters 
was limited by practical considerations. 
On each of the 16 days of the experiment 
a rater made ratings based on five projec- 
tive-technique records from 5 different 
subjects. For example, on the first day 
Rater A would have worked with the 
Rorschach records of Subjects 1 and 16, 
the TAT of Subject 10, the SC of Subject 
12, and the B-G of Subject 4. This same 
"block" of records would be given to 
Rater B on the eighth day, to Rater Con 
the fifth day, and to Rater D on the six- 
teenth day. In this way each of the 16 
blocks of five projective-technique rec- 
vould be worked with by each of 
aters, so that at the end of the 
would have rated all 
20 subjects. 


ords v 
the four r 
16 days each rater 
the projective records on all 
Tables of random numbers were used to 
assign the projective technique records 
to the 16 “blocks,” after which the 
blocks were treated as units and distrib- 
uted by random numbers to the raters. 
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TABLE 10 


MEDIAN INTERCORRELATION COEFFICIENTS FOR 
EACH or Four RATERS WHEN RATINGS BASED ox 
FOUR TECHNIQUES ARE INTERCORRELATED* 


Rater 
Variable 

A B C D 

4 .32 215 10 .o6 

18 .o8 її E zt 
23 —.06 +20 = 03 +02 
25 -04 = „#5 -06 .18 
31 .02 .32 281 .20 
42 -05 -26 -16 +14 


* Correlation coefficients which are underlined 
are significant at the -05 level. 


The ratings were then examined for con- 
sistency of rating for a rater over the 
four techniques, and for the consistency 
of ratings on a given technique by the 
four raters, in both cases for 20 subjects. 

In Table 10 are shown the results for 
the consistency of the individual raters, 
ie, the intra-rater consistency over ull 
four techniques. The data are presented 
in the form of median values for the 6 
intercorrelations of the four techniques. 
The single correlation which appears to 
be significant (Rater C, Trait #31) may 
be meaningless in that at the .o5 level 1 
correlation іп 20 may be expected to 
reach this level of significance. 

In Table 11 are shown the inter-rater 


TABLE i: 


MEDIAN [NTERCOR 
ЕАСН or Four Т 


Technique 


Variable 5 

Ror ТАТ 5С BG 

4 34 .18 

18 ‚78 244 

23 36 +20 

25 „17 .20 

3 «61 34 
42 34 -34 248 


ч " Эг a ined 
* Correlation coefficients which are underlit 
are significant at the .o5 level. 


(intra-technique) agreements. ‘These 
again are median correlations for the Е 
intercorrelations of the ratings of four 
raters for the same technique. It appears, 
from the data in these two tables, that и 
projective technique tends to generate 
тоге consistency in rating behavior than 
the use of a single projective rater. Stated 
another way, it would appear that differ- 
ent raters will tend to rate a subject 1n 
the same way if they use the same pie 
jective technique. A given rater will tene 
to rate the same subject in a nonconsist- 
ent manner when he uses different tech- 
niques. "n 


Ё 


CHAPTER V 


SUMMARY AND CONCLUSIONS 


А. OBJECTIVES 


T HE principal objectives of this study 
were: 

1. To determine the relative validities 
of ratings based on four projective tech- 
niques when these were used to describe 
personality and to predict “over-all suita- 
bility” as a clinical psychologist; 

2. To determine whether there were 
differences in the relative validities of 
ratings based on projective techniques 
which were ascribable to the rater; 

3. To determine whether there were 
differences in the relative validities of 
ratings based on projective techniques 
which were ascribable to the technique: 

4. To determine whether there were 
differences in the relative validities of 
ratings based on projective techniques 
Which were attributable to the personal- 
ity trait being rated. à 

Other related problems were also in- 
vestigated. 


, В. METHODS AND PROCEDURES 


During an intensive assessment pro- 
Bram, a total of 128 male first-year gradu- 
ate students in clinical psychology were 
rated by ten staff members on 15 per- 
Sonality variables after analysis of proto- 
cols from each of four projective tech- 
niques, and again after all the projective 
Material (except the actual ratings) from 
the four techniques had been examined 
a “projective integrator." These rat- 
ings were correlated with another set of 
ratings which were arrived at in à “pool- 
mg” conference of three stall members 
Who had studied each subject intensively 
‘or a week. Since staff members had all 
the information it was possible to obtain 


19 


about a subject during ап assessment 
week, the ratings which the three staff 
members agreed upon in their final con- 
ference were taken as the best-rated de- 
scriptions of a subject’s personality and 
used as criterion measures. These cri- 
terion measures were “contaminated” in 
that they included the protocols and rat- 
ings of the predictors, the effect of which 
would be spuriously to raise the correla- 
tions between ratings based on projective 
techniques and criterion measures. Under 
these conditions the correlations between 
ratings based on projective techniques 
and the final staff ratings were regarded 
as validity indices. By comparing the cor- 
relation coefficients which were obtained 
in this manner, the objectives of this 
study could be achieved. 


C. SUMMARY OF FINDINGS 


1. The projective techniques. 


a. Ratings based on the projective 
techniques correlated significantly 
with the criterion measures more 
frequently than was expected by 
chance. These correlations were 
preponderantly positive, but were, 
by usual standards, low. 

b. Correcting the criterion measures 

for attenuation raised the median 

correlations between ratings based 
on projective techniques and the 
criterion measures only slightly. 

The greatest increase was from .31 

to .35- 

Ratings based on the Rorschach 

and the Bender-Gestalt (made by 

the raters who had administered 
these techniques) tended to be 

made with greater confidence, i.e., 
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showed greater spread, than ratings 

based on the Thematic Appercep- 

tion Test and the Sentence Com- 
pletion (which were rated 

"blind"). 

Ratings based on the Rorschach 

tended to be made away from the 

“laudatory” end of the ratings scale 

when compared with ratings based 

on the other projective techniques 
and with the criterion ratings. 

*. There appeared to be little or no 
relation between validity of ratings 
and bias of ratings toward either 
the "laudatory" or “derogatory” 
ends of the rating scale. 

f. There appeared to be little or no 
relation between validity of ratings 
and spread of ratings. 

g- Preliminary findings suggested that 
there was more correlation be- 
tween ratings made by different 
raters using the same projective 
technique, than between ratings 
made by a single rater using differ- 
ent projective techniques, 


А 


2. The projective raters, 


a. Differences in the validity of rat- 
ings based on projective techniques 
were found which could be attri- 
buted to the individuals 
the ratings. 

b. Significant differences in the valid- 
ity of ratings obtained not only be- 
‘tween raters, but for the inter- 
action between rater and tech- 
nique, for both scales and for the 
Rorschach, the Thematic Apper- 
ception Test, and the Sentence 
Completion; interaction could not 


making 


be tested fcr the Bender-Gestalt. 


- Although some raters were "better 


than, others, in no instance did the 
median validity coefficients of sta- 
tistical significance exceed r = .48. 


3. The Traits. 


The conclusions which 


No significant differences were 
found in the validity of -— 
which were attributable to the dif- 


ferences in personality traits rated. 


D. CONCLUSIONS 
are drawn 


from the findings of this study are: 


1. 


Projective techniques, used in ше 
assessment of personality character- 
istics, measure very little in conr 
mon. 


- There аге significant individual di 


ferences in the ability to make valid 
ratings of personality traits from 
projective techniques, which appear 
to be independent of the technique 
used. 


" " А ? by 
- The dispersion of ratings made Py 


clinicians on personality waits on 
the basis of projective пеле 
does not appear to be related to th 
validity of ratings. ] 


res 0 
- The assessment of the degree 


Which a subject possesses socially 
desirable personality traits is, i? 
part, a function of the projective 
technique which is used in making 
the assessment. 


s ә iques 
- The value of projective techniq" 


as instruments for the assessment 2 
Specified personality traits in е 
group of normal superior айе 
apparently limited by low validiti 


oe 
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Introduction 
Procedures and Methods 


Results 


The Rating Scales 


il present research stems directly 
from the University of Michigan 
Assessment of Clinical Psychologists 
Project which is being conducted under 
contract with the Veterans Administra- 
tion. This is a large-scale, joint research 
Program designed to determine experi- 
mentally the necessary qualifications of 
а clinical psychologist. In its very design 
it offers numerous subsidiary opportuni- 
ties to test the validity of the techniques 
employed in the project. One of these 


PROCEDURES 


КО ЧЕ ЖЕЕ алаа талы аак = 


А. Tur University or MICHIGAN PROJ- 
ECT IN THE SELECTION OF CLINICAL 
PsyCHOLOGISTS* 


| HE present description will be 
| limited to the Ann Arbor program 
| carried out during the summer of 1947, 
| Since the data which serve as the basis of 
| the study come from that phase of the 


| 1 x 
Sant was a five-year study conducted under 
Ў S with the Veterans Administration dating 
September 1946, under the direction of 


4 р 
| ТОЁ, E, Lowell Kelly, Project Director. 
| 


Summary, Conclusions, and Sugg 
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RORSCHACH ESTIMATES OF PERSONALITY ATTRIBUTES 
IN THE MICHIGAN ASSESSMENT PROJECT 


estions for Further Research ... 20 


CHAPTER I 


INTRODUCTION 


techniques is the Rorschach method, 
which is the one studied in this investiga- 
tion. 

The purposes of this research are: (a) 
to demonstrate that by using data ob- 
tlined by means of the Rorschach meth- 
od, valid estimates of personality varia- 
bles may. be obtained; and (b) to com- 
pare clinical estimates with those based 
upon specific Rorschach scores or pat 
terns of scores reputed to be descriptive 
of the variable in question. 


CHAPTER П 
AND METHODS 


total research project. As described in 
the project’s first Progress Report and 
Preliminary Fndings (6), the professional 
staff in 1947 consisted of thirty members, 
including two VA psychiatrists and sev- 
eral VA psychologists. Other staff mem- 
bers were psychologists drawn from five 
different universities and several other 
institutions. This resulted in considera- 
ble diversity of background, training, 
and viewpoint. 

The subjects were student VA trainees, 


№ 
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already accepted for training by one of 
the cooperating universities. They came 
to Ann Arbor in six successive classes of 
24 each at nine-day intervals, each class 
remaining for seven days. Each class was 
divided into six teams of four students 
each. Each student team was studied in- 
tensively by a staff team of three mem- 
bers. 


B. THE ASSESSMENT Projecr RATING 
SCALES 


A rating scale which would permit of 
clinical judgments on a variety of per- 
sonality attributes was first tried in the 
1946 preliminary program and revised 
for the 1947 program. The ratings on 
this revised rating scale form the basis 
for the assessment research (see Appen- 
dix A). 

This rating scale has three parts: Scale 
A was intended to cover primarily pheno- 
typic variables, descriptive of the subject 
as seen by the staff at the time of assess- 
ment. Including 22 variables, it was con- 
structed with the help of Professor Ray- 
mond Cattell on the basis of his several 
factorial studies of personality ratings 
(2). 

Scale B was intended to provide judg- 
ments of more genotypic variables, i.e., 
evaluative judgments of broader under- 
lying variables, again as seen by the staff 
at the time of assessment. It includes 10 
variables. 

Scale C includes a list of 11 criterion 
variables on which staff members were 
asked to make predictive judgments rela- 
tive to the future performance of each 
candidate (five years after assessment). 

All ratings were made on an 8-point 
scale, with a theoretical distribution of 
ratings as follows: 


8 Upper 3% o“ a population of first-year gradu- 
ate students, 
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Š ” a irst-vear grad- 
7 Upper 7% of a population of first-year 8 
uate students. — 
6 Upper 15% of a population of first-year gr? 
uate students. 3 
5 Upper 25% of a population of first-ye 
uate students. * "— 
4 Lower 25% of a population of first-year gi? 
uate students. Ет 
3 Lower 15°% of a population of first-year g 
uate students. А 4 
2 Lower 7%, of a population of first-year 
ate students. 
г " adu- 
1 Lower 3% of a population of first-year gr 
ate students, 


ar grad- 


gradu- 


For Scale C, the reference population 
was VA trainees five years after assess" 
ment. Staff members were instructed a 
give anyone who they believed wey 
fail in the training program a тай 
1, 2, or 3 on Item 42 (“over-all suitability 
for clinical psychology”). 


C. THE CANDIDATE's SCHEDULE 

1 о 
Upon arriving in Ann Arbor and reporting | 
the sorority house being used for housing И ШП 
actual assessment research, the assembled “proj: 
dates were given a welcoming speech by the reo 
ect Director, who indicated the general nani way 
the program. They were told in a gener? that 
what was expected of them and assurcc main- 
strict professional confidence would be by t 
tained for all personal material gathered y 
project. 

"That same morning the group W 
battery of objective tests. At lunch, à$ s 
meals during the first five days, each t€ 
at a specified table, along with any ^ e 
members who would not be evaluatitis class 
team. In the afternoon of the first day, (160 о 


a 
wem Y 
as give! T 

sat a 


п sat 


ol 
1 Н А end 

continued taking group tests. Before Ше (акеп: 
three days, the following tests had beer the 


Allport-Vernon Study of Values, LM tery 
tional Interest Blank, Guilford-Man v and 
(Inventory of Factors STDCR, GAM Multi- 
Personnel Inventory I), and the Minoo ge 
phasic Personality Inventory. During h subject 
day or, sometimes, the next day, ed alt 
took the Rorschach and the Bender-Gc5U 
each at separate sessions. 

The first afternoon, each student h 
itial Interview" lasting one hour. 
Viewer, unknown to the subject, 
studied the student's "credentials 


ad an ч 

T 
he } 1 
hac атой) 
file,” 
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р he had submitted With his application 
ӘН Mb These included the transcript 
and Васо све grades; his Civil Service Form 57 
behalt S i recommendation submitted in his 
le a his interview was searching but not 
deep lest anxiety be aroused in the subject. 
NA Be evening of the first day, each 
ЖН 4 1 ed out а Biographical Inventory, 
ontained over a hundred multiple-choice 
co about background, personal history, ех- 
ences, and preferences. He also received an 
outline for an autobiography he was to write 
within the next two days. 
Eh thia day, more objective tests were 
Rea cred including the Kuder Preference 
as ce the ACE Culture Test. The Strong 
lie tho a twice more: once, he filled it out as 
ae ug yi it would be answered by | women 
general” and finally as he thought it would 
be answered by "men in general." These results 
were not made available to the assessment staff. 
Late that afternoon, each subject met his “in- 
tensive interviewer,” the staff member whom he 
Would get to know best and the person whose 
ob it v to get to know the assigned student 
best. ‘This interview was thorough and probing. 
sl. nature of the interviewer's questions, it 
аз obvious to each student that the interviewer 
pes carefully examined his credentials, auto- 
biography, Biographical Inventory, test scores, 
and the other materials on which the student 
had spent three days. 
ši The fourth day was free : a 
8 itsecing. The fifth day was spent in а variety 
" Situational procedures which were observed 
i staff members. These situations were of three 
inds: (1) a group, or team situation, in which 


f "mn fA 
Tom four to eight students participated jointly, 


(2) dual situations, and (3) individual situations, 
alone, in the 


eee each student participated 
ce of staff members only. 
a morning of the last day, “ies 
last у ed in the group testing room for t еш 
È sg written work, which was the completion о 
пае ee ie questionnaire concerning his m 
and as to his classmates, and a rating of himse 
Б his three teammates. 
jam aming this, he had a fina 
ent ae with his interviewer. Ози 
the st ent to this interview expecting to learn 
Staff's opinion of him, but came away with 


relativ, B 
etc. tively little information, such as test scores, 


for relaxation and 


the students 


1 individual ap- 
Usually the stu- 


D. Tur Starr SCHEDULE 
ments can be 
tion of stu- 
tant aspects 
tove will 


ba fee the staff time allotm 

dent ame the foregoing descrip 

Of staff RES Only the more impor 

ye dj, Activities not clea-ly indicated a 
cussed in this section. 
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During the earlier portion of the week the 
intensive interviewer prepared for his intensive 
interview with the student assigned to him by 
studying, in order, (1) the credentials file, (2) 
the objective test profiles and answer sheets, (3) 
the autobiography and biographical inventory, 
(4) the projective test protocols and their inter- 
pretations, After each of these four sets of ma- 
terials he made ratings on Scales B and C. Thus, 
cach of the four sets of ratings was based on a 
cumulative collection of materials. Each rating 
was filed before making his next rating. i 

The projective tests were handled as follows: 
each student took both the Rorschach and the 
Bender-Gestalt Tests individually. Each was in- 
terpreted and summarized by the administrator 
of the test. The Thematic Apperception Test 
and the Sentence Completion Tests were ad- 
ministered as group tests and were analyzed by 
various staff members. No staff member analyzed 
more than one projective test for any one sub- 
ject. In addition to the qualitative interpretation, 
the projective analyst made ratings on the vari- 
ables of Scale B and Scale C on the basis of 
each projective protocol. Thus, four sets of rat- 
ings on Scale B and Scale C each, were based on 
individual projective techniques alone. In addi- 
tion, a “projective integrator” made ratings based 
ow all of the projective data collected. 

The interviewer usually spent about four hours 
preparing for the intensive interview. After the 
interview, which lasted about two hours, ratings 
on Scale B and Scale C were made once again. 

At this point, each team of three staff mem- 
bers held a conference to discuss their four stu- 
dents. These preliminary conferences had two 
purposes: the first was to discuss the case and, by 
subjectively pooling the three individual and 
independent ratings on each variable, to arrive 
ata pooled or team rating on each variable; the 
second was to provide for a full exchange of 
data and opinion about each case—with both 
the initial and the intensive interviewers re- 
porting on their interviews. 

On the following day, each staff team observed 

four students in the situational procedures. 

ngs were not made after each situ- 
am ratings were made from notes 
the four students observed. The 
preliminary pooling conference consisted in each 
staff member's making a set of ratings based on 
his total impression of the student up to and 
including the situation tests. The interviewers 
than held Final Interviews with the students 
whom they had first seen in Intensive Inter- 
views. The substance of this interview was re- 
ported to the other two team members. The 
staff members then examined the tabulations of 
the sociometric questionnaire and studied the 


teammates’ ratings of each other and the stu- 


its 
Separate габіт 
ation; staff te 
the next day on 
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dent self-ratings. They also read the character 
sketches to determine how each student appeared 
in the eyes of his teammates and to estimate the 
insight of the author of each sketch. Also, for 
the first time, they were permitted to examine 
all the ratings which had previously been made 
on each subject. Upon the basis of all of these 
data a new rating, the Final Individual Rating 
on each variable, was made. These last were 
taken by each staff team member to the Final 
Team Conference at which the staff team made 
its best judgments about each case in the light 
of the entire week’s assessment. This compre- 
hensive report considered many aspects of the 
person: his emotional life, his intellectual func- 
tioning, his relations with others, his motivation 
for clinical psychology, etc. From a research point 
of view, its most important function was to 
record qualifications about certain ratings: e.g. 
the staff might rate a certain case with the 
understanding that he would soon be undergoing 
psychotherapy. 

The ratings coming out of this conference for 
each student were designated the Final Pooled 
Ratings. Since it is the most comprehensive and 
inclusive set of ratings which was made during 
the program and since it involved the pooled 
judgments of skilled clinicians who had been 
afforded ample opportunity to “get to know each 
subject as God knows him,” it is proposed to use 
those ratings as criterion ratings in the present 
investigation. 


E. SunJEcrs, DATA, AND STATISTICAL 
DESIGN 


In the present study, the subjects con- 
sist of a group of 120 male students as- 
sessed during the 1947 summer program 
in Ann Arbor. All were student VA 
trainees who had already been accepted 
for training by one of the cooperating 
universities. 

The data to be analyzed are drawn 
from three sources: (1) the final pooled 
ratings (criterion ratings) on the ten vari- 
ables comprising Scale B, and on Vari- 
able 42 of Scale C (“over-all suitability for 
clinical psychology”); (2) the ratings on 
the same variables made by the Rorschach 
examiners, based upon information they 
obtained from the Rorschach records; 
and (8) Rorschach scores and patterns 
obtained directly from the Rorschach 
records. 


Only Scale B variables are being used 
because Rorschach ratings were not al- 
ways made on Scale A during the assess 
ment program and because it is felt that 
most of the items on Scale С are too spe 
cifically oriented toward professional 
skills айй, hence, remote from the usual 
type of data reportedly gleaned a, 
Rorschach results. On the other hanc. 
it is rather universally held that the 
Rorschach method taps more covert, 
genotypic personality attributes and this 
is the definition of the Scale B variables- 

Six Rorschach examiners administer 
approximately four records each бина 
each week of assessment. Each scored » 
records, following whatever system b 
familiar to him, most using the "A 
symbols designated by Klopfer (8), s 
though some used Beck's categories es 
while one used a system combining ^7 
tures of both of these. For the sake Ы 
uniformity, all scores were studied PY 
the writer and converted to those fe 
Klopfer insofar as information availa 
in the records permitted. 


5 ratings 

It is proposed to correlate the Qr 

made by the Rorschach examiners Ы the 
inafter designated “Judges”) wit) © 


tac] a- 
final pooled ratings (hereinafter bus 
nated “Сгіегіоп”) variable-by-VAT ich 
in order to determine the extent tow "e 
judgments based on Rorschach infor 


х à à "erigi judg 
tion will approximate the criterion Ји 


п 
: uoi "n ved ! 
ments. Since six judges are dee - d 
à Р n 
making the Rorschach ratings E = 
imat 


gree to which the criterion is est idiec 
by the individual judges will be e be- 
by means of running correlanoni 8 
tween the ratings of each judge an 
criterion ratings. This will result 
array of six correlations for each va 
and each of such arrays will ne ining 
by Rider’s technique (5) for dete d cot 
the homogeneity of a distribution 
relation coefficier ts. 


jn ап 
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testet 
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In half of the criterion teams the 
Rorschach examiner was a functioning 
team member. Since this introduces the 
possibility of contamination in the cri- 
terion ratings, the data will be split 
into contaminated and uncontaminated 
groups and separate correlations com- 
puted for each group. Under ordinary 
circumstances of contamination it might 
be expected that the contaminated data 
would show higher correlations than the 
uncontaminated. 

The study of individual Rorschach 
Scores and patterns descriptive of the sev- 
eral variables involved will be discussed 
individually. 

Social Adjustment: The scores and 
patterns to be used in predicting this 
variable (Variable 23b) are listed below. 
The rationale behind the selection of 
these particular Rorschach factors lies in 
the interpretative values assigned to 
them in the literature. 

1. Normatively, the number of responses usu- 
ally given to the ten ink-blot designs by healthy; 
Normal adults ranges from 30 (0 40. In varying 
degrees of social maladjustment, it has been ob- 
Served that the number of responses frequently 
is less than this, often ranging downward from 
25 responses, Miale and Harrower-Erickson (4), 
Or example, report а heterogencous group of 
Neurotics as giving an average of only 13 Te 
ET only three cases producing more than 25 
bo es: Their normal control group averaged 
а responses by comparison. Decreased produc- 
enl is often interpreted as reflecting onc who 
Sill at ease and lacking in drive and spontaneity. 
п the present investigation, therefore, the tend- 


с " : ре 
Ncy to give less than 25 responses will be taken 
ustment. 


2. Human movement responses are ordinarily 


inga Preted as indicating the subject's degree of 
di is maturity and stability. Normally xi or 
this of such responses are expected; less than 
-àis number suggests a lack of these character- 


їйгє. Afe ara 
e Miale's neurotics, for instance, avcraged 
Y 1.1 M. while the normal controls averaged 


79 and all had produced two or more of this 
vios Of response. Less than two M responses will 
jae eded as a second partial sign 0 
5tment, 
3. Animal movement responses, 
» are interpreted as more primitive, infa 


f malad- 


designated as 
ntile 
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inner drives in contrast to the more mature hu- 
man movement responses. Normally it is ex- 
pected that in healthy adults, M will exceed 
FM, usually by two to onc. In Miale's neurotic 
group, 67 per cent of the records showed FM to 
be greater than M; the normals produced more 
M than FM in 70 per cent of the records. Indi- 
cations of such an excess of immaturity in the 
inner life in the records of the assessment gfoup 
will be taken, therefore, to be related to social 
maladjustment. 

4. Color responses in general in Rorschach in- 
terpretation are reputedly related to emotional 
responsiveness to affectively toned stimuli from 
the subject’s environment. Form responses are 
interpreted as indicating intellectual control. 
Hence, responses determined by a combination 
of form and color, with form elements рге- 
dominating (FC), are reflective of controlled 
emotionality, hence, emotional adjustment. Two 
or more of such responses are normally ex- 
pected. Neurotics, according to Miale's study, 
produce an average of only o.6 FC responses 
while her normal controls averaged 3.1; stated 
differently, 81 per cent of the neurotics gave no 
more than one FC and an equal per cent of 
the normals gave more than one. In fact, 70 
per cent of the neurotics produced no FC re- 
sponses at all. For this reason, less than two 
FG responses will be regarded as indicative of a 
lack of emotional adjustment and more than two 
as suggestive of good emotional adjustment and 
good rapport with others. 

5. Another pattern, related to the previous 
one, but more indicative of emotional imbalance, 
excitability, and egocentricity is given by the 
extent to which responses in which intellectual 
control is subordinated to emotionality (CF) or 
in which intellectual control is completely lack- 
ing (С) exceed the more controlled FC responses. 
Such imbalance and egocentricity is posited as 
indicating social maladjustment. 

6. Normally зо to 50 per cent of Rorschach 
responses involve the perception of animal 
figures. A per cent of responses in excess of 50 
per cent is regarded as mental stereotypy. In 58 
per cent of Miale’s neurotic cases animal re- 
sponses constituted over half of the responses; 
only 25 per cent of the normals showed this sign. 
Thus, over 50 per cent animal responses in the 
present records is interpreted as indicating a lack 
of spontaneity associated with social maladjust- 
ment. 2 
Also related to spontaneity in Rorschach in- 
terpretation is the per cent of responses deter- 
mined by form alone. Too high a per cent of 
form responses is interpreted as a restriction of 
spontaneity, with an attempt to substitute intel- 
lectual control for genuine adjustment. Normally, 
go to 50 per cent of the total number of responses 


is expected to be determined by pure form. Fifty- 
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one per cent of Miale’s neurotics showed this 
sign compared with only 20 per cent among the 
normals. Following this, subjects who produced 
over 50 per cent form responses are regarded as 
having one more sign of social maladjustment. 

8. Color shock has long been regarded as in- 
dicative of emotional disturbances and inhibi- 
tions in response to emotionally toned stimuli 
emanating from the environment. Color shock 
was defined in the present study as follows: 

а. A significant delay, over one average devi- 
ation, in time of responding to color cards, es- 
pecially П and VIII, 

b. Exclamations or comments by the subject 
felt to be indicative of disturbance in reaction 
to these cards. 

c. Decline in the quality of responses, de- 
terioration of mode of approach sequence, or 
failure to produce commonly perceived responses 
on the color cards, 

d. Rejection of color cards with no scorable 
response. Using similar criteria for color shock, 
Miale found the reaction to be present in 98 per 
cent of the neurotic records and in only 20 per 
cent of the normal records. 

9. Shading shock, referred to by Klopfer as 
"sexual" shock, are reactions similar to those 
described above to the two highly shaded cards 
(IV and VI) and occasionally to the diffusely 
shaded card VII. Such a reaction is interpreted 
as indicative of considerable anxiety, often re- 
lated to sexual conflicts. This sign was present 
in 81 per cent of Miale's neurotic records and 
in only 20 per cent of the normal ones. The 
presence of either color shock or shading shock 
is regarded as indicative of poor social adjust- 
ment, 

10. Finally, the complete rejection of any card 
with no scorable response is rarely observed 
among normal, healthy adults, Of Miale’s psycho- 
neurotics, 47 per cent rejected one or more cards, 
the range was from one to seven of the ten 
cards, None of her normal controls showed this 
type of reaction. Rejections in the present study 


will be regarded as another sign of maladjust- 
ment, 


These "signs" of social maladjustment 
will be treated in two different ways. 
The absence of signs will be correlated 
with the criterion ratings to determine 
the extent of concomitant variations be- 
tween them by means of the usual Pear- 
son product-moment method. Second, 
since Miale and Harrower-Erickson (4) 
suggest that the presence of five or more 
signs strongly indicates social maladjust- 


ment, a biserial correlation coefficient 
will be computed, the dichotomous маре 
ables being designated as records having 
ing less than five signs and records һау- 
ing five or more signs of maladjustment 
Appropriateness of Emotional el 
pression: "This variable is closely dr 
to certain of the patterns enumerate? 
above, specifically the response categories 
designated FC, CF, and C, The fus 
ordinarily interpreted as indicative 9 
emotional responsiveness 
while the latter two suggest progressively 
more disorganized emotionality. 1 ; 
correlations between these individu? 
factors will be determined and then cm 
bined to determine the multiple correla 
tion coefficient obtaining among Шет 
and the criterion ratings. In pu 
patterns 4, 5, 7, and 8 noted above d 
Social Adjustment are felt to be ана 
to appropriateness of emotional exp? " 
sion. A biserial coefficient of npe 
will be run betwecn these patterns. i e 
the criterion; one dichotomous varia of 
will be the presence of less than poeta 
these patterns, the other two or ™ tec 
The former is expected to bà жеш 
to more appropriate emotionality, d 
latter with failures to adapt pod 
responses to the needs of the aa m 
Characteristic Intensity of Inner ed 
tional Tension: Classically, in Rorsc?' yë 
interpretation, human movement 
sponses (M), and more recently a per- 
movement responses (FM) and е ол 
ception of inanimate objects in ™ 
(m) have been regarded as Men 
with the inner life of the i it 
The former is deemed representat” 


" 
levelol 
a more mature, stable stage of © e the 


re 
= а mo 
latter two represent progressively “aden 
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immatare, inhibited, and tens! in 
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state. Hence, these three facto! 
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records will be correlated individually 
with the criterion ratings on this varia- 
ble (Variable 25) and then combined to 
determine the extent of multiple corre- 
lation among them and {Ше criterion. 
Since a low rating indicates minimum 
tensions and a high rating suggests 
strongly repressed drives resulting in in- 
ner turmoil, a negative correlation CO- 
efficient should be expected for the cor- 
relation with M, a positive one with 
m, with FM taking a middle position. 
| Another pattern will be studied here 
involving the conception noted above 
that M should exceed FM normally. To 
study this pattern, the writer devised an 
index expression which results in values 
ranging from zero to two às follows: 
(М-РМ) /(M-+-FM). Scores closer to zero 
would represent the preponderance of 
M in the record while scores approach- 
ing two reflect the excess of FM over M. 
Negative correlation between these val- 
ues and the criterion ratings would be 
expected, 

These same factors will be treated in 
still another way. A biserial correlation 
coefficient will be computed with M = 
ЕМ апа М > FM as the dichotomous 
variables. 

Since inner emotional tensions are 
Plausibly related to social adjustment 
(Variable 28b), it is proposed that the 
ten patterns used there be employed 
again here. In this instance it would be 
€xpected that the more signs of malad- 
Justment, the higher should be the cri- 
terion rating on inner emotional ten- 
sion, 

Sexual Adjustment: Two Rorschach 
Scores are often used to estimate Sex- 
ual adjustment developmentally. Animal 
Movement responses (FM) are frequently 
interpreted as indicative of more basic, 
instinctual, sexual drives which in adults 


may be interpreted as a fixation at an 
early level of psychosexual development. 
Another way of gauging this factor is 
in comparison with the more mature in- 
ner drives as reflected by human move- 
ment responses (M). Thus, the num- 
ber of FM responses in the records and 
the above-described index showing the 
relative weights of M or FM will each 
be correlated with the criterion ratings 
on Variable 26. It would be expected 
that each should yield a negative correla- 
tion with sexual adjustment if the in- 
terpretative assumptions indicated above 
are to be retained. 

Sexual shock reactions, defined under 
the section on Social Adjustment, are 
ordinarily interpreted as indicative of 
anxiety over sexual conflicts and, hence, 
of sexual maladjustment. In order to 
assess the value of this pattern a point 
biserial coefficient of correlation will be 
run against the criterion ratings, the di- 
chotomous variables being presence and 
absence of sexual shock in the records. 

Motivation for Professional Status: 
There are no factors in the Rorschach 
which are presumed to be related to such 
able as this one. However, "drive 
is suggestive of Ror- 
involving the 
ize responses to 


a vari 
for status rewards" 
schach interpretations 

tendency to over-emphas 
the whole ink blot (W), frequently re- 
ferred to as “ambition.” Whole responses 
have also been compared with human 
movement responses and norms are 
given in the literature which indicate 
that the healthy balance between these 
two factors is approximately 2:1. When 
W exceeds expectations, “ambition” over 
and above basic creative capacities is in- 
Some Rorschach examiners also 
at this same personality complex 
ge number of re- 
Rorschach experi- 


ferred. 
feel th 
is indicated by а lar; 
sponses to the whole 
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ment. Therefore, it is proposed that four 
correlations be run against the criterion 
ratings on Variable 27: (1) number of 
responses utilizing the whole blot (W), 
(2) per cent of responses utilizing the 
whole blot (%, W), (3) scores given by the 
formula (W-2M), and (4) total number of 
responses given (R). In each instance 
positive correlation coefficients would be 
expected. 

Motivation for Scientific Understand- 
ing of People: Again, this represents a 
variable which has no clear counterpart 
in Rorschach scores or patterns. It may 
be assumed, however, that scores inter- 
preted as reflecting interest in and. em- 
pathy for others, and thinking which is 
in keeping with that of one's contem- 
. poraries might be plausibly related to 
this variable. Content categories involv- 
ing the perception of human beings are 
an example of the former type while 
popular responses, i.e., those commonly 
Seen by other persons, are an example of 
the latter. Thus, three correlations will 
be run against the criterion ratings on 
Variable 28: (1) number of responses in 
which the content was human beings 
(H), (2) per cent of responses in which 
the content was human beings (96H), 
and (3) number of popular responses 
(Р). In each instance positive correla- 
tions might be expected. 

Insight into Others: There are no par- 
ticular Rorschach factors specifically re- 
lated to this variable insofar as the 
literature is concerned; this is equally 
true of the next variable, Insight into 
Himself. However, reference has been 
made from time to time to a more re- 
stricted kind of insightfulness, ie. in- 
sight into anxieties. The presence of this 
personality characteristic js inferred 
from responses determined in part by 
form in combination with either dif- 


fuse shading and/or surface texture їп 
the ink blots. Diffuse shading (К) is in- 
terpreted as anxiety in the inner life, 
hence, the combination of form and dif 
fuse shading (FK) represents anxiety 
over which the individual is able to ex- 
ert intellectual control and, hence, anx- 
iety into which he has insight. Surface 
texture, especially in relation to dys- 
phoric concept, is interpreted as anxiety 
in relation to environmental occur- 
rences; the combination of form and tem. 
ture (Fc) suggests situational anxieties 
under intellectual control, or anxieties 
into which the person has insight. 
Reasoning similarly, form and color A 
sponses (FC) may be interpreted as in 
trolled, or insightful, emotional respon 
siveness to environmental stimuli. 
patterns will be used in two ways: e 
the sum of responses in which form e A 
ments were primary and combined s. 
textural and diffuse shading аы. 
minants (Fc + FK), and (2) the sum 0 


: . r were - 
responses in which form and color we! 


combined determinants, form pound 
nating (FC). These will be employed d 
both Variables 29 and go since they 566 d 
so closely related by definition and ica 
preliminary study reveals the correla:io 
between them to be .8o. lish- 
Quality of Intellectual Accomp ae 
ments: Intellectual quality in pur 
Work is ordinarily inferred from sala 
quality of the subject's responses. M. a 
ity is defined as the degree to whic 5 
given response is apposite to reality p 
is designated as F+. In general, the 
higher the per cent of F + responses, cel- 
better the quality of the subject's eet 
lectual work. In addition to this ot 
originality of responses of good a 
(О +) is interpreted as high-level к у 
lectual ability, Originality is вш 
defined as à response given арр! 


EN 
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mately once in a hundred records. A neg- 
atively oriented factor related to this var- 
lable is the percentage of animal forms 


(%A) seen. This score is interpreted as . 


reflecting mental stereotyp when the 
percentage exceeds half of the total 
number of responses given. Thus, four 
correlations will be run against the cri- 
terion ratings on Variable 31: (1) per 
cent of F+ responses, (2) the raw num- 
ber of original responses given (O), (3) 
the number of original responses of good 
quality given (O+), and (4) the per- 
centage of animal responses (%4). In the 
first three instances, positive correlations 
Should result; in the latter, the correla- 
tion should be negative. 
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Over-all Suitability for Clinical Psy- 
chology: This variable is obviously 
neither a specific personality characteris- 
tic nor is it one which has ever been 
related to Rorschach results. However, 
one might posit the hypothesis that over- 
all suitability is logically related to over- 
all social adjustment. Working on this 
hypothesis, it is proposed that the ten 
patterns of adjustment used in study- 
ing Variable 23b be used here. It will be 
remembered that the absence of these 
signs was felt to be related to adjust- 
ment, hence, one should expect a posi- 
tive coefficient of correlation in this case 
if the hypothesis is to be retained. 


e 


CHAPTER III 


RESULTS a 


N THIS chapter we compare the cri- 
I terion ratings on each variable with 
(a) the ratings made by Rorschach ex- 
aminers, and (b) the various Rorschach 
scores and patterns. 


A. VARIABLE 28b: SOCIAL ADJUSTMENT 


Social adjustment was defined for the 
raters as follows: "How well does he ad- 
just to varied. interpersonal situations? 
(Includes sexual adjustment only as it 
affects social adjustment in general. )’ On 
this variable, the higher the rating, the 
more it indicated a person who “actively 
considers the feelings of others; readily 
gains acceptance in interpersonal rela- 
tionships; maintains a friendly and like- 
able manner.” The lower the rating, tke 
more it indicated one who “acts without 
consideration for the feelings of others; 
often rejected by others; often appears 
aloof, hostile, or irritable.” 

The correlations between the criterion 
and ratings by the Rorschach “judges” 
are shown in the first column of Table 
Bs 

On this variable the Rorschach judges 
were able to predict the criterion rat- 
ings to the extent indicated by an r 
of .35. This can be interpreted as indi- 


cating a pésitive relationship and one 
which is significantly greater than zero 
at better than the 1 per cent level of 
confidence. 

As will be noted in Table 1, 
apparently a wide spread of r's among 
the six judges (from .26 to .63), and = 
is tempted to conclude that Judges 4 
and B were able to estimate the criterion 
ratings better than the other four judges. 
However, Rider's method of testing the 
homogeneity of such a distribution bs 
rs yields a chi-square value of п 
which with five degrees of freedom give 
a p of .50, indicating that the areay, ix 
r's is probably homogeneous. The in е 
ence of a difference between опе јони? $ 
and the others might, therefore, be € 
roneous. . 

In Table 2, while the contaminated 7 
appears to be greater, the null hypot e 
esis that there is probably no е 
between these correlation coefficient 
may be retained (p = .16). ns 

The ten Rorschach scores and p 
described in the preceding chapter prie 
studied in an effort to determine to aie 
extent scores alone might be used to р 
dict the criterion ratings on “sagal M 
justment.” The absence of these sig 


there is 


TABLE 1 


CORRELATIONS BETWEEN RORSCHACH RATINGS AND CRITERION RATINGS 


€ 


Obtained correlation coefficients by variables* 


r required at 


1 
Judges N vor level 
i 23b 24 25 26 27 28 29 зо 31 C42 .os level > 
41 162 
А 23 -6r -37 -49 -45 -02 43 28 55 -44 25 M 
B ME E ou чу бу Md 38 38 
© 19 -32 мб о зү — .17 26 44 24 10 .27 65 hs :58 
D 21 .28 28 —.20 123 138 38 —.os 48 015 9 Nt] 28 
Е 19 46.44 аз 138 164 24 24 зо .47 46 46 
F 19 27 18 .o8 15 —.13 32 27 27 -25 23 34 
в > 
Total 120" „35 +43 +24 +26 де .38 .23 27 33 +35 Ж 


* Correlations which are statistically significant at the .os level of confidence or better are printed in нака 
жж N d total 120 since one judge rated only three subjects and is excluded from the analysis 


but is included in the total correlational analysis. 


" ges 
dividual ча 


10 


i aii 
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, TABLE 2 


ErrECT OF CONTAMINATION ON THE CORRELATIONS BETWEEN 
RorscHACH RATINGS AND CRITERION RATINGS 


С 
Varia Contami- Uncontami- ; Critical 

ble nated r 0 nated r ЮНЕ ratio 2 
23b -443 .278 +165 1.02 .16 
24 500 .560 — .обо 0.48 “зї 
25 348 .163 .185 1.06 15 
26 118 403 — .285 1.64 o5* 
27 469 +193 ‚276 1.66 05 
28 541 -497 -044 0.33 37 
29 174 .280 . 106 0.59 .28 
зо 119 доо .281 1.62 ag 
31 258 367 = .109 0.62 «27 
2 280 391 —.III o.66 25 


,* While this difference is significant at the .os level of confidence, note that it is in the opposite 


‘rection from that hypothesized. 

Was correlated with the criterion ratings 
її two different ways; the results are pre- 
sented in Table 3. The Pearson r, com- 
puted from a scattergram, yielded a co- 
efficient of .47; this is somewhat better 
than was obtained for the typical judge's 
ratings (y — .95)- 

. The use of these ten factors was stud- 
led.in another way, since in the litera- 
ture it has been suggested that the 
presence of five or more of them is a 
Critical number of differentiating ad- 
JUstment from maladjustment. The com- 
Putation of biserial correlation produced 
an yj = .55, which is significantly 
8reater than zero at better than the т 
Per cent level of confidence. 


B. VARIABLE 24: APPROPRIATENESS OF 
EMOTIONAL EXPRESSION 

This variable is defined as: “How ар- 
Propriate are his emotional responses to 
the situation?” The lower the ratings 
the More it indicates an individual who 
fails to adapt his emotional responses 
to the needs of the situation; shows dis- 
Organized, or overly constricted emo 
md responses." The higher the rating, 
€ more it indicates one who "shows 
mE responses of a quality and in- 
Ну befitting the situation; reacts 


spontaneously but appropriately; shows 
wellintegrated and flexible patterns of 
emotional behavior." 

The correlations between the Ror- 
schach judges' ratings and those of the 
criterion are shown in column two of 
Table 1. The results here are similar to 
those obtained on Variable 23b. The 
r is slightly higher and more in keeping 
with the lower levels of validity obtained 
on many psychological tests; again, the 
total r is positive and significantly 
greater than zero at better than the 1 
per cent level of confidence. 

The chi-square test of homogeneity 
of the distribution of r’s among the six 
judges yielded a chi-square value of 
8.07 and a p of .15. This also may be in- 
terpreted as indicating a homogeneous 
array of r values. 

The investigation with respect to con- 
tamination yielded results which may be 
interpreted as indicating no significant 
contamination effect. 

Various Rorschach scores and pat- 
terns were studied in relation to this 
variable. First, the three factors FC, CF, 
and C responses were employed. Using 


the following indices, 


1 The criterion ratings to be predicted, 
2 FC responses, 
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3 CF responses, 


tween ratings by the judges and the cri- 
4 C responses, the following zero order r's were 


terion (r = .43), although those involv- 

ure Sarg. Ws Алы ing FC and CF are significantly greater 

E E cm p than zero. The multiple correlation ‘Or 

Гов efficient involving the above correlation 
M,=4.20 М. M,=266 M,=0.23 


G=115 = 2.38 66 o,= 0.63 matrix yielded Кызы = 33. P 
Second, the four “signs”: (1) FC 
d ' FW reg Ses 
None of the three zero order 7% ap- sponses less than two, (2) %F respons 


X /0 
3 А A ó 
proaches the size of the correlation be- greater than 50 per cent, (3) presence 


TABLE 3 


CoMPARISON OF ESTIMATIONS OF CRITERION RATINGS BY CLINICIANS 
AND FROM RORSCHACH PATTERNS 


Estimate of Cri- Estimate of Criterion 
Variable terion by Judges by Rorschach Indices 
(Table 1) and Patterns 
Tuis 
23b. Social Adjustment ү .35* m 
24. Appropriateness of Emotional Expression +43 FC: ‚2 4 
CF: .28 48 
533° 
25. Intensity of Inner Emotional Tension ‚24 М: - “37 .o9* 
FM: —.04 
ті “її 
d 3 
— .об! 
23% һ 
26. Sexual Adjustment ‚26 М: —.00 T 
FM: —.02 
ў ы М:ЕМ: — log 
27. Motivation for Professional Status “32 W: - "c 
TW = .07 
Н жып... 
NR: a red ` W—oM: —.1 
|. 28. Motivation for Scientific Understanding of .38 3 . зб 
People .07 j 
—.16 ' 
29. Insight into Others 129 Ес ЕК: . го 
ЖУМ Э Р ЕС: s 
30. Insight into Himself -27 Fc--FK: ой 
е ЕС: а 
31. Quality of Intellectual Accomplishments -4 %Е+: on 
QA: —.18 
О: 
С 42 Over-all Шү for Clinical Psychol- 35 ore ^ 
ogy (five years hence) ы 
* Italicized coefficients аге si 


: 2:28 
4 Т ignificantly greater than zero at the 5 per cent level or better (7.0 :1°' 
„=, Ц 

adjustment (see page 5). 


Page 7). 
® Group dichotomized on the basis of M< FM and М> FM 
һ Point biserial correlation group dichotomized (page 7) Р al shock гё 
actions (page 7). zed on the presence or absence of sexu 


pi 
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color shock r : : 
е shock reactions, and (4) ЕС less 

а 
E Wi the sum of CF plus C patterns were 
studied in relation to the criterion rat- 
ings. A biserial r was cói 
di ial r was cómputed, the 
E chotomous variables Бейле the pres- 
E of less than two "signs" on the one 
ha 
mus and two or more on the other. 
^ is yielded а biserial r of 48, which 
qM 
м ignificantly greater than zero at bet- 
er 

than the 1 per cent level of confi- 

dence, 


C. VARIABLE 25: CHARACTERISTIC INTEN- 
SITY OF INNER EMOTIONAL TENSION 
Tayip is defined as “How in- 
ед p his inner emotional Ше as in- 
low ens «jin abt ШШ eri Herera 
CMM Ing suggests an individual whose 
a е life is characterized by 
Cc ren of persistent internal ten- 
“Ба ne МВВ rating indicates one who 
resultin ongly repressed emotional drives 
р in inner turmoil; great Inner 
Col and strong pent-up emotions. 
ишш three of Table 1 presents the 
ge between ratings of the Ror- 
ings Hee re and the criterion rat 
is - [ere again the total correlation 
zerc E and significantly greater than 
six fu = distribution of 7s among the 
of 6 DEBEAMUS such as to yield a chi square 
Bard th B 80 and we may again re- 
los e distribution as relatively ho- 

geneous, 
ee to Table 2 suggests that 
ently gang contamination appar- 
Signific oes not affect the results to @ 
R ant degree. 
ЧА ШП factors reputedly related to 
"he ene duy tension" were studied. 
Volving of these were the responses 17° 
tions и human movement percep- 
and ) » (2) animal movement (ЕМ), 
in icu rue ge of inanimate objects 
п (т). The following correla- 


tion matrix was found in this investiga- 
tion: 

Criterion ratings 

M responses 


1 
3 FM responses 
4 m responses 


al 
M,=6.30 M,—436 M,=0.85 
FAL gi—3.31 00—917 


The correlation observed between the 
criterion ratings and human movement 
responses alone is approximately the 
same as that observed between the Ror- 
schach judges and the criterion (-24)- 
Computing the multiple correlation co- 
efficient yields Кузы = -35 which ap- 
pears to be somewhat better than that 
yielded between judges’ ratings and the 
criterion. 

Other patterns studied included the 
hiserial r between patterns of M = FM 
on the one hand and M > FM on the 
other. This yielded practically no cor- 
relation (rii; = .og). These same two 
scores were combined to give an in- 
dex ranging from o to ? à$ follows: 
1-(M—FM)/(M + ЕМ). The resulting in- 
d with the criterion rat- 


dices correlate 
(r = —.06). The, 


ings almost not at all 
ten patterns used with Variable 23b were 


used again in this instance, and yielded 
a Pearsonian т of .23; this is about as 


good as the correlation between the rat- 


ings of the judges and the criterion. 


D. VARIABLE 26: SEXUAL ADJUSTMENT 

The general question involved in this 
variable was: "To what degree do his 
sexual needs and activities affect his over- 
all adjustment?" Here, the lower the rat- 
ing, the more it indicated a person whose 
“sexual needs and activities seriously in- 
terfere with his overall adjustment.” 
The higher the rating, the more likely 
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it indicated an individual whose "sexual 
needs and activities definitely enhance 
his over-all adjustment." 

Column four of Table i presents the 
findings with respect to the ability of 
the Rorschach examiners to predict the 
criterion ratings on sexual adjustment. 

The results here are similar to those 
obtained on the previous three variables. 
The total correlation coefficient is posi- 
tive and significantly greater than zero at 
less than the 1 per cent level. The dis- 
tribution of rs yields a chi Square 
= 1.64, p = .go. In line four of Table 
? We observe a significant difference be- 
tween the 7's at the 5 per cent level, but 


not in the expected direction for 


con- 
tamin 


since 
r is significantly 
the contaminated one. 
ear explanation for this 
type of difference in relation to the cor- 
tamination hypothesis. 

Rorschach scores selected for study in 
relation to sexual adjustment included 
(1) M responses, (2) FM responses, (3) 
the M : FM ratio and (4) the factor des- 
ignated as “sexual shock.” Briefly, the 
first three scores and patterns yielded es- 
sentially no evidence of correlation be- 
ing of the order of magnitude —.og, 
—:08, and .о5 respectively. Biserial corre- 
lation, on the other hand, in which the 
dichotomous variables were absence of 
“sexual shock” and presence of “sexual 
shock” produced a point biserial r with 
the criterion ratings of .37 which is sig- 
nificant at less than the 5 per cent level. 
In using this result, one predicts a mean 
criterion rating on sexual adjustment of 
4-33 for the group having little or 
“sexual shock”: the b 


the “sexual shock” 


rating of 3.43. The 
cantly different at 


ation to have been the cause, 
the uncontaminated 
greater than 

There is no cl 


no 
est prediction for 


group is a criterion 
зе means are signifi- 
less than the 1 per 


P 1 Rac | these 
cent level of confidence. Each ol : : 
H s "у ГОТ 
means is also significantly different чре 
2) а 

the mean af the total group (3-82) 


about the 1 per cent level. 
2 
/ATION FOR 
E. VARIABLE 27: MOTIVATION 


PROFESSIONAL STATUS 


Involved in this variable are € 
aimed at stating how strong the ш 
drive is for the status rewards of a рї ) 
fessional career. Low ratings tend i 
indicate low drive, high ratings sugges 
strong drive, 

Сойтш five of Table 1 үа е 
findings indicating the ability © en 
Rorschach judges to estimate ue ed 
terion ratings on this variable. The s 
sult here, as reflected in the icona pen 
coefficient of .g2, indicates positive i^ 
comitant variation to a degree iun 
cantly greater than zero at better th? 
the 1. per cent level of confidence. x 

Chi square for the distribution me 
judges’ »'s is 12.36, p < .o5. This 10t 
only array of »'s which is apparently ee 
homogeneous. In this instance the маче 
lations оѓ Judges В апа E are hon A, 
geneous and so are those of Judges Win 
C, D, and F. The two groups of T 
geneous »'s were then combined by lif- 
2 transformation and produced a ins 
ference significant at less than the ! Lll 
cent level. This suggests the probabi tly 
that Judges B and E were nen 5 
better at estimating the criterion rat! 8 
than were the other four judges. aye 

Line five of Table g gives the only ав 
dence in favor of the hypothesis cor 
there might be significantly greater We 
relation between the Rorschach e 
and the criterion contaminated by the 
Rorschach examiner’s presence руне 
criterion team than between the 


к d 
+ aminate 
Schach ratings and an uncontam 
criterion, 


RORSCHACH ESTIMATES OF 


The series of Rorschach scores and 
patterns studied relative to this variable 
Esas (1) number of responses utilizing 

e whole blot (WW), (2) per cent of re- 
sponses using the whole blét (% W), (3) 
total number of responses given (К), and 
(4) the normative score given by the for- 
"ula (IV-2M) yields values designed to 
show the relative excess of IV over normal 
expectations of M. 
шо these scores yielded negligible 
жн = That between W and the 
Prid was —.04; between Ф апі 
. n —.07; between R and criterion 
Shee and (W-eM) correlated with the 
Titerion —.17. None of these are posi- 
гаа nor аге they significantly greater 
н zero at the 5 per cent level of con- 
fidence, 


F. 
VARIABLE 28: MOTIVATION FOR SCIEN- 
TIFIG UNDERSTANDING OF PEOPLE 


here the raters are asked to judge 
rong the subject's drives are to- 
ward acquiring the facts, theories, and 
skills necessary for the scientific under- 
epe of individual human beings. A 
low rating signifies low drive, 2 high rat- 
ing a strong one. 
Б six of Table 
die ш! with respect to t i 
both he total correlation is .38 and ы 
han aps and significantly greater 
1 an zero at less than the 1 per cent 
evel, 
. The distribution of r's among the six 
ав yields а chi square of 0.995: 
> -95. This may be interpreted as in- 


dic i . B H 
Ps aüng a homogeneous distribution of 


1 shows the find- 
his vari- 


an d Mig of the possible effect afa 
sults mated criterion yielded the re- 
Sate M in Table 2. From these 
ination it may be concluded that contam- 

n probably had little or no effect 
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in the direction hypothesized. 

Rorschach factors studied in relation 
to "understanding people" were: (1) 
number of responses in which the con- 
tent was human beings (Н), (2) per 
cent of responses involving human be- 
ings (95H), and (8) number of responses 
in which percepts were of the type com- 
monly seen by other persons (P). None 
of these produced correlations signifi- 
cantly greater than zero. 


G. VARIABLE 29: INSIGHT INTO OTHERS 


The task here was to rate the subjects 
on the amount of insight they possess 
into the attitudes, emotions, and motiva- 
tions of others. A low rating suggests an 
individual who “interprets behavior at 
its face value; is insensitive to any but 
gross differences in behavior; does not 
develop any integrated understanding 
cf behavior or of people.” A high rating 
indicates the person who “has good 
awareness of underlying dynamics of be- 
havior; is sensitive to subtle nuances of 
behavioral responses; is able to develop 
integrated understanding of the be- 
havior of people.” 

The correlational findings relative to 
the ability of the “Rorschachers” to es- 


timate the criterion ratings on Variable 
lumn seven of Table 


29 are given in co 
al correlation of 


1. Here again the tot 
9 is both positive and significantly 
greater than zero. The distribution of 
the six judges yields a chi 
for which p is .90. "This 
indicating a homo- 


rs among 
square of 1.87 
is interpreted as 
geneous array of r's. 

The contamination-study results on 
this variable are shown in Table 2. The 
null hypothesis that there is probably 
no difference between these 7's is re- 
idea that contamination 


tained, and the 1 
was a factor operating to increase the 
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degree of correlation is rejected. 

Two Rorschach scores were considered 
sufficiently relevant to this variable to 
warrant study: (1) Sum of responses in 
which form clements were primary and 
combined with textual and diffuse shad- 
ing determinants (Fc + FK) and (2) Sum 
of responses in which form and color 
were combined determinants, form pre- 
dominating (FC). The former values 
when correlated with the criterion rat- 
ings produced a coefficient of .16, the lat- 
ter a coefficient of .17. While both of 
these are positive, they only approach 
the value -(.18) which is significantly 
greater than zero at the 5 per cent level. 


Н. VARIABLE go: INSIGHT INTO HIMSELF 


On this variable the judges were asked 
to rate each subject as to “how much 
insight does he have into the underlying 
dynamics of his own attitudes, emotions; 
and motivations?” The higher the rat- 
ing, the more the rater felt the subject 
had insight into himself, 

The correlations obtained i 
tion with this variable 


column eight, Table 1, The correlation 
coefficient of :27 is positive and signifi- 
cantly greater than zero at less than the 
1 per cent level. The distribution of 
coefficients among the six judges pro- 
duced a chi-square value of 3-903; р 
is .60 and the distribution may be re- 
garded as homogeneous, 

The “contamination” 
a significant difference 
case of Variable 96, 
difference is the теу 
on the basis of со 


п connec- 
are presented in 


study produced 
but, as in the 
the direction of the 
erse of that expected 
ntamination effects, 

The same two Rorschach patterns 
Which were used in the preceding varia. 
ble were studied in relation to this vari- 
able: (1) (Fe + FK) and (2) FC rè. 
sponses. The resulting correlations were 


positive but not significantly greater 
than zero. The obtained r's were .08 for 
the pattern (Ес + FK) and .17 between 
FC responses and the criterion, the lat- 
ter approaching significance at the 5 
per cent level of confidence. 


I. VARIABLE 31: QUALITY OF INTELLEC- 
TUAL ACCOMPLISHMENTS 


The key question involved in this Wale 
able was: “What is the characteristic 
quality of his intellectual output?” & 
high rating suggests one who "character- 
istically produces intellectual work of 
high quality." A low rating, one whose 
"intellectual work is characteristically of 
low quality." 

The correlation observed between Ше 
judges and the criterion on this varia- 
ble was .33. The breakdown of correla- 
tions by judges is shown in column nine, 
Table 1. The total correlation is posi- 
tive and significantly greater than gee: 
The distribution of 7's among the judge 
produced a chi square of only 3.867 а 
Р of .бо which indicates the probability 
that the distribution is homogeneous: 
Again there is no evidence that contam 
ination had the effect expected. 

The Rorschach scores studied inielo- 
tion to "quality of intellectual ape. 
plishments" included: (1) per cens 3 
responses determined by “good а 
(Е), (2) per cent of tapome 
animal figures (9,4), (з) number of mee 
inal responses (O) and (4) number In 
good quality original responses (O Fii 
all of these, positive correlations pelos 
pected with the exception of 764 "The 
would be expected to be negative. are 
correlation coefficients obtained ad 
given in Table 3. The correlations ifi- 
volving %A and O+ approach nd 
cance at approximately the 5 per © 
level of confidence. 
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› 
J. VARIABLE C-42: OvER-ALL SUITABILITY 
FOR CLINICAL PsvcHOLOGY 


In the assessment rating: scale, Scale 
c is concerned with characteristics more 
directly related to clinical psychology 
per se. It was felt that it would be of in- 
terest to include Item 42 [or two reasons: 
(1) because it is the rating relative to over- 
all suitability, and (2) because it was 
nsed in the Preliminary Report as a cri- 
terion rating. The rating is future- 
oriented in that it required a rating “of 
the subject as he may be five years from 
pow” The reference population is VA 
Clinical Psychologists who have had four 
years of academic and on-the-job train- 
ing (U. S. Civil Service grade-classifica- 
Чоп of “P-4” or above). The general 
qüestion was worded thus: “In view of 
his assets and liabilities, how well will 
he be able to carry out the several duties, 
diagnosis, therapy and research specified 
for the position of clinical psychologists 
(P-4 and above) in the VA?” The higher 
the rating, the greater his suitability; the 
lower the rating, the less his suitability 
With the added stipulation that ‘a “тас 
ing of s or below means that it is doubt- 
ful if the candidate will ever qualify for 
ард rating.” 

The results of the correlation anal- 
Yses for Variable C-42 are presented in 
on ten of Table 1. The total corre- 
EM of .35 is positive and is signifi- 
s Y greater than zero at better than 

1е 1 per cent level of confidence. The 

istribution of ;'s by judges is homo- 
гош; chi square being 5.984. 
not i d Here again contamination does 
Pee to be a factor operaung to 
se correlation (Table 2). 


here are, of course, no Rorschach 
' is now desig- 


1 

ag 
па he grade-classification, "P-4' SIB 
J. S. Civil 


ted aj 
Seri, 29 "GS-11" in official VA and 1 
ce regulations, 


scores or patterns of scores designated as 
related to this variable but since it is 
an overall rating, plausibly related to 
social adjustment, the ten "signs" em- 
ployed in relation to social adjustment 
on Variable 23b were used again here. 
The obtained correlation coefficient is 
.52. 
К. THE JupcEs 

As noted above, there was some ques- 
tion of variability among the judges with 
respect to their ability to estimate the 
criterion ratings. This question was 
answered in part in the studies of the 
distribution of 278 among the six judges 
variable-by-variable. In brief, all of the 
distributions indicated the probability 
of homogeneity with the exception of 
that on Variable 27 where Judges B 
and E appeared to be able to predict to 
a significantly greater degree than the 
other four judges. 

It is the writer's opinion that signifi- 
cant variability does, in fact, exist among 
the judges even though the above studies 
seem to contraindicate it. Partial justifi- 
cation for such an opinion may be seen 
in the following. The individual judges’ 
ions may be viewed from another. 
standpoint, that of the number of varia- 
bles each was able to predict to an extent 
significantly greater than zero at better 
than the 5 per cent level of confidence 
(reading across Table 1). This analysis 
results in the following information: 

1. Judges A and B were each able to 
predict six of the ten variables at ap- 
proximately the 5 per cent level or less. 

2. Judge E was able to predict five 
variables at approximately: this level. 

з. Judge C was able to predict only 
three variables. 

4. Judge D wa 
one variable. 

g. Judge Е was a 


predict 


s able to predict only 


ble to predict none. 
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Ona priori grounds, there being no 
statistical technique known to the writer 
for analyzing such data, it would appear 
that Judges A, B, and E might be re- 
garded as better judges than C, D, and F, 
who among them made only 4 predic- 
tions at approximately the 5 per cent 
level or better, compared with the 17 
significant predictions made by the 
former group. 

It is obvious that using judges who 
lack the ability to make accurate predic- 
tions would operate as a systematic fac- 
tor in lowering the over-all correlation 
between judges' ratings and the cri- 
terion. Stated differently, given six 
judges, all of the caliber of Judges A, 
B, and E, we should expect significantly 
higher over-all correlations with the cri- 
teria than those obtained and reported 
above. Other logical arguments in favor 
of the general hypothesis that the 
judges vary greatly in ability are evident 
in even a cursory examination of the ex- 
periential backgrounds of the judges 
themselves. Professional courtesy forbids 
Stating here all of these ey 
to do so w 
of identif. 
flect on t 
erations 


idences since 
ould leave open the possibility 
ying the judges and might re- 
hem personally, "These consid- 
Suggest an ancillary investiga- 
tion of the importance of the experien- 
tial backgrounds of Rorschach judges. 


Г. Tue RATING Process 


Certain factors in the rating process it- 
self were studied in an effort to try to 
understand the relative lowness of the 
correlation coefficients between judges’ 
ratings and criterion ratings. 

Among these were included such items 
as systematic errors of measurements (or 
better, errors in rating) with regard to 
the requirement that the raters fit their 
ratings into a predetermined distribu. 


tion (see Appendix A); limited range ar 
spread of ratings among the eight pro- 
vided by the scales; and the setting in 
which ratings were made. Some evidence 
was uncoveied to support the idea that 
the raters did not produce a “good fit 
in distributing their ratings as pier 
scribed and also that there was a limited 
range of ratings used. While these errors 
may be trivial in their consequences, 
they are reported as sources of error for 
what they are worth, ПИС 
The fact that the Rorschach examiners 
found themselves functioning in a situa- 
tion somewhat removed from their usual 
clinical settings, under a certain amount 
of pressure of time, and making oniga 
interpretations in the form of ratings ad 
a rating scale with which they had € 
limited experience is a factor worthy is 
consideration. At least this suggests tha 
the general situation was not an xe 
mum one for careful, accurate WO! 
with a complex instrument. " 
While nothing can be done about th 
first two factors at the moment, ше 
matter of experience with the 
scale might suggest the hypothesis pia 
with experience in the use of the qs 
correlation might increase, This possi rd 
ity was examined by dividing the на 
classes in half and comparing the co! 
relations based on Rorschach aime 
made during the first three weeks е 
those based оп Rorschach nn 
made during the last three, The ee 
of this analysis are presented in Ta se 
4- Here it will be observed that in т 
eral the correlations either a 
about the same or increased. Бри, e 
Variables 24, 25, 26, and 27 there pera 
marked change; in the remaining jani 
ables there appears to be a 11916 Pt 
nounced change in the ail 
pected. The analyses of the signific: 
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TABLE 4 


SIGNIFICANCE oF DIFFERENCE BETWEEN 


RORSCHACH AND CRITERION CORRELATION COEFFICIENTS 
Last THREE WEEKS (IV-VI) OF ASSESSMENT 


FOR First THREE WEEKS (I-III) AND 
Sad Obtained r Critical 
Variable : Diff.: Ratio P 
1-1 IV-VI 
23b ET .49 .2806 т.56* .o6 
24 43 ді .0243 0.13 45 
25 .26 23 .0320 о.18 43 
20 .20 .24 .0538 0.30 138 
27 231 .35 -0449 0.25 до 
28 138 “51 21627 0.90 .18 
29 18 .30 +1275 о.7І +24 
30 .16 ET .2985 1.66 .05 
31 .25 44 .2168 1.21 її 
2 .24 48 .2782 1.55 .o6 


* gp, =о.18 based on N (I-III) =61 and N (IV-VI) =59- 


of the differences between these 1's re- 
veals that the differences are probably 
true” ones in the instances of Variables 
23b, go, and 42 at or about the 5 per 
cent level of confidence. Thus, it would 
арреаг that there is some reason to be- 
lieve that experience with the rating 
cal? led to better predictions. 
Certainly in connection with all these 
Considerations, mention must be made 
ОГ the fact that correlations of this type 


are undoubtedly lowered by two other 


important factors: (1) the fact that the 
Rorschach is as yet only a crude in- 
strument and even were it otherwise, one 
would not expect anywhere near a per- 
fect analysis or evaluation through апу ` 


chometric technique; and (2) 


single psy 
aking 


the fact that the rater himself, m 
subjective estimates such as he is re- 
quired to do, is no doubt a potent source 
of uncontrolled error of estimate. 


CHAPTER IV 


SUMMARY, CONCLUSIONS, AND SUGGESTIONS 
FOR FURTHER RESEARCH 


HE problem of this study is the va- 
“Г нау with which personality attri- 
butes may be estimated from data ob- 
tained by means of the Rorschach meth- 
od of psychodiagnosis. Two aspects of 
the general problem have been consid- 
ered: (1) the validity of estimates made 
by Rorschach examiners based upon 
Rorschach protocols they had obtained; 
and (2) the validity of various Rorschach 
scores and patterns of scores taken di- 
rectly from the Rorschach records and 
regarded as related to the variables in 
question, 

The procedure was to collect criterion 
ratings made by teams of observers who 
had had the opportunity to observe from 
many diverse viewpoints 120 male, VA 
trainee subjects throughout a week of 
intensive assessment activities provided 
in the University of Michigan Assess. 
ment of Clinical Psychologists Project 
during the summer of 1947. The subjects 
were assessed in groups of 24 over a 
period of six weeks, Assessment ratings 
were made on a specially devised rating 
Scale at the end of each week of assess. 
ment. In this study only the more covert, 
genotypic variables constituting Scale B 
and the “over-all suitability” rating on 
Scale C were employed. Next, clinical rat- 
ings on the Same variables mage by 
Rorschach examiners and based on the 
Rorschach protocols and psychograms 
were obtained and correlated with the 


six Rorschach 
5 between the 
€xaminer and 
n in an effort 
of ability and 


examiners, the correlation 
ratings of each individual 
the criterion were also ru 
to estimate the factors 


9 
2 


1, 

variability among the examiners. In each 
case, the total correlation based on all 
120 cases was tested to determine the 
possibility of curvilinearity, with the > 
sult that all of the correlations appearec 
to be linear, eta never exceeding the 
product moment coefficient at less than 
the 5 per cent level of confidence. | 

For each of the 10 variables, Ror- 
schach scores and patterns deemed to be 
of value in estimating the variable in 
question were isolated, These were neg 
taken directly from the Rorschach i 
Ords and correlated with the criterion 
ratings by correlational methods most ж 
keeping with the type of data being 
studied; these included product-moment, 
biserial, and multiple-correlation tech- 
niques. А 

The results of these investigations ips 
dicated that in all 10 of the variables 
studied, the Rorschach examiners Were 
able to estimate the criterion nu 
positively and to a degree significantly 
greater than zero at approximately the 
1 per cent level of confidence. The range 
of the correlation coefficients was from 
-23 (0.43. aif 

Since Rorschach examiners sat on ha | 
of the criterion teams, the possibility x 
their having contaminated the ане M 
ratings and thus having increased be 
Correlations between their Rorschac 
ratings and the criterion ratings hee. 
helped to establish, was studied by b 
paring the "contaminated" cornea | 
with the “uncontaminated.” It was СО а 
cluded that contamination as € 
above was not particularly effective 2 
spuriously increasing the correlation 
efficients, 
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The several Rorschach scores and pat- 
cons studied revealed much variability 
ame aro to predict the criterion 
Нога н nging from low negative corre- 

ons to a positive .52. Some of this 
Variability is undoubtedly due to the 
fact that in several instances the Ror- 
Schach patterns used were only approxi- 
к of the variables in question. 
оа ои 27: Motivation for Pro- 
bt sha "n Stains was regarded (in terms 
fen of "eade as essentially a ques- 
28: M DG and ambition ; Variable 
eit otivation for Scientific Under- 
Standing of People was interpreted as 
‚Чеге in and empathy for others"; 
and the two “insight” variables, 29 and 
30, were correlated with Rorschach pat- 
terns suggestive of "insight into anxi- 
Sues. rather than insight into others 
and into himself as defined on the rating 
Scale. Correlations significantly greater 
than zero were obtained on the following 
Variables: ' 


= Variable 29b: Social Adjustment 
es Variable 24: Appropriateness of Emotional 
"Xpression 
r pariable 25: Characteristic Intensity 
motional Tension 
4. Variable 26: Sexual Adjustment 
5: Variable g1: Quality of Intellectual Accom- 
Plishments ` у 
cap pitiable Са: Over-all Suitability for Cin 
Sele Sychology (defined as “social adjustment” in 
«ting Rorschach patterns). 


of In- 
ini- 


Kn comparing the obtained correla- 
corre] in the above instances with the 
made xe between the clinical ratings 
terion y the Rorschachers and the cri- 
Case w. TAGES nt Was found that in no 
as there a difference significant at 

i n cent level or less. ы? 
Cally à t the other variables, the pn 
and Pe Dip estimates were superior, 
Е interesting to note that these 
Precisely the variables noted above 
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for which only approximate Rorschach 
patterns could be devised. 

Since it is commonly felt that correla- 
tions should be near .бо in order to 
speak of valid predictions, it would ap- 
pear that the obtained results fall far 
short of indicating validity for either the 
ratings made by the Rorschach examin- 
ers or the estimates based on Rorschach 
scores. On the other hand, when investi- 
gating psychological problems, even very 
small correlations, if statistically signifi- 
cant, are frequently indicative of psy- 
chologically lawful relationships. The 
fact that the correlation coefficients are 
small may only mean that the measure- 
ment situation is contaminated, uncon- 
trolled, not clearly defined, or that meas- 
urement itself is crude owing to the meas- 
uring instrument employed. In the pres- 
ent study, it has been demonstrated 
tat many of these latter factors were 
operating to varying degrees. 

While there was in general no statis- 
tically significant. degree of variability 
among the predictions of the six Ror- 
schach judges on the several variables, 
evidence in the form of the number of 
variables estimated at less than the 5 
cent level of confidence indicates 
the probability that three of the Ror- 
schach judges were relatively "good," 
ing a total of 17 significant pre- 
in contrast to the remaining 
a total of only 4 


per 


produc 
dictions, 
three who produced 
significant estimates. It is probable that 
the three inferior Rorschach raters 
tended to lower the total correlations. 
Partial evidence would support this split 
of the judges on the basis of their pro- 
fessional and experiential backgrounds. 

In view of the foregoing, and in view 
of the relative inadequacy of any single 
technique such as the Rorschach method 
to supply all the answers, it is not sur- 
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prising that the observed correlations 
were as low as they were, and gratifying 
that they were so consistently positive 
and statistically significant. It is the 
writer’s opinion that had a large part of 
the sources-of-error variance been con- 
trolled, correlations much nearer to a 
level suggestive of valid prediction would 
have resulted, 

On tlie basis of these results we may 
conclude that: 

1. Clinicians, using Rorschach data, 
are able to make estimates of covert per- 
sonality characteristics with a validity 
coefficient of the order of “35, as repre- 
sented by the present sample of ten at- 
tributes, 

2. Relatively clear personality attri- 
butes and complexes, such as “social ad- 
justment” and “appropriateness of emo- 
tional expression,” can be equally well 
estimated from certain Rorschach scores 
or patterns of scores; those which are 
more specific, such as “motivation for 
professional status” or “motivation for 
scientific understanding of people,” were 
not as successfully estimated by the score 
approach as they were by the clinical ap- 
proach, 

3. Some Rorschach examiners may be 
adjudged “good” raters while others must 
be regarded as “poor” raters; the differ- 


ence seems to lie in the difference of 
their backgrounds of professional train- 
ing, experience, and interests. | 

A number of problems for further x 
vestigation suggest themselves, a few o 
Which may be mentioned here. In the 
fist place, a new set of ratings, com- 
pletely "blind," might be obtained цол 
à new panel of Rorschach "experts, "i 
order to evaluate the possible effects o 
personal contact with the subjects. See 
ond, the problem of reliability of Ror 
schach ratings should be studied by дам 
ing a number of Rorschach examiners 
rate the same records and by studying 
interjudge agreements. Third, more €x 
tensive study should be made of the ue 
portance of extent of familiarity with = 
Rorschach method, breadth of genera 
clinical experience, working knowledge 
of personality dynamics, and so forth r 
factors correlated with the ability ye 
clinicians to estimate personality ашї 
butes from data obtained by the Rol 
Schach and other projective methods. 
Fourth, and related to the preceding sug 
gestion, work should be done to да" 
mine the more specific effects of the Be 
sonality of the clinician upon his mE 
schach-based ratings of personality ctt 
butes. 


APPENDIX A 


RESEARCH PROJECT ON THE SELECTION OF 
CLINICAL PSYCHOLOGISTS 


REFERENCE POPULATIONS FOR RATINGS 


For Scales A and B the candidate is rated as 
he is today. The reference group is first-year 
clinical psychology graduate students in universi- 
ties accredited by the APA to offer training in 
Clinical psychology. 

For the Criterion Skills (Scale C), the candi- 
date is rated as he will be five years from now. 
The reference population is VA clinical psycholo- 
gists who have had four years of academic and 
on-the-job training (Р- and above). In rating 
а candidate on the Criterion Skills, the assump- 


Lefi-Scale A 
Low-Scale B 


Fic, 1. 


tion is made that he will have completed the 
training and will have been employed by the 
VA. A rating of 3 or below means that it is 
doubtful that the candidate will ever qualify for 
a P-4 rating with respect to the trait being rated. 
It is possible that some candidates will later 
qualify for a P-4 position even though they rate 
з or below on a few Criterion Skills. 


RATING SCALE 


All ratings will be made in terms of an eight- 
point scale illustrated graphically in Figure 1. 


Right-Scale A 
High- Scale B 


Theoretical distribution of ratings 


RATING SCALE DEFINITIONS 
Scale A (#1-22 


(For ratings on this scale, 


А 2 5 4 


ee The attributes in Scale A refer to b 
n using this scale, disregard any inferences a 


| — extreme on left side, 


ehavior which can be directly obse 


bout underlyi 


8 — extreme on right side.) 


7 8 


5 6 
rved on the surface. 


ng dynamics or causes. 


—v- Obstructiveness 


‚ Readiness to cooperate 


Finds ways of cooperating despite difficulties. 


n 


* Consistent 
Behaves in the same gener: 
to day, 


al way from day 


3- Assertive 
Attempts to dominate or influenc 
SOciates, 


e his ac- 


4: Depressed 
es not smile or laugh easily or fr 


—v- Inconsistent 


у= Submissive 


-у- Cheerful 
quently- 


Frequently is “difficult.” 


Shows changing and unpredictable moods and 


behavior. 


Tends to let people have their way. 


Generally bubbling over with good cheer. Opti- 
mistic. Enthusiastic. Prone to cheerful, witty re- 


marks. 
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- Irresponsible -У- Serious : йй онай 
Not inclined to take responsibilities ѕегі- Accepts appropriate responsibilities 
ously. Thoughtless. Unaware of responsibili- others. Shows seriousness of purposc. 


ties of his age. (Do not confuse with #17: 
Conscientious уз. not conscientious.) 


6. Gregarious (adient toward people) =v- Non-gregariows (abient from people) 
Is attracted by and moves toward people in In social groupings, isolates himself. 
social situations. 

7. Easily Upset =v- Unshakable | йн 
Easily embarrassed or put off balance. Gets Self-possessed. Does not lose composure u 
confused in emergency. Blushes, shows ex- emotional provocation. 
citability, becomes incoherent. Momentary 
“nervousness,” not general emotionality, 

8. Narrow Interests ~v- Broad Interests " ide 
Uninformed in many arcas. Narrow, simple, Talks and acts in an informed way in a Wi 
interests. Provincial outlooks, variety of areas, 

9. Suspicious Trustful E 
Believes rather too quickly that he is being Accepts statements of others without suspicio! 
unfairly treated. Imagines on insufficient (not necessarily "gullible.") 
grounds that people Strongly dislike him. 

Interprets things as having reference to him- 
self when none is intended. Feels persecuted. 

10. Generous ~v-Self-centered, selfish ain 
Generous and considerate in actions involy- Irritable and resentful or withdrawing fro" 
ing others at considerable self-sacrifice, situations requiring consideration of Ше 

e Talks and acts exclusively in terms of OW 
interests, 

11. Silent =v- Talkative sura 
Says very little. Talks a lot, to everybody. Takes the initiati : 

in conversations, When addressed, respon 
quickly. 

12. Cautious -v- Adventurous — 
Avoids the Strange and new. Looks at all Secks and readily enters into new experienc 
aspects of a situation overcautiously, Does and situations. 
the safe thing. 3 

13. Socially poised and adept =v-Socially clumsy, awkward in social situations е 
Polite, poised, and tactful in social situa- Tactless in social situations. Crude in speech АП 
tions. Deals with People gracefully and skill- manners, Omits proper formalities, Does not Me 
fully. people gracefully, Gauche, or 

Note: Applies to relationships with one 
more people. 

14. i ; 

: Be to his own ideas and does not ada bi mea а ; А ituations 
th wes Gf doluy ditm Шо Fi a әр! Appropriately Modifies his behavior to Ж not ур" 
с Dons nor КОМО i on is Accepts compromises where needed. e ings are 
perience. n with ex- Set, surprised, baffled, or irritable if th 

different from what he expected. 

15. Dependent 


~v-Self-sufficient ; ling for 
Does not lean on others in situations calling 
independent action, 


Asks for reassurance and su 
himself to individual 
relying on himself, 


Pport. Attaches 
5 and groups instead of 


- Placid 


=v- Worryin i 

Outwardl я ying, anxious PRN 

ardly шщ and relaxed. Appears: to worry constantly, harried; 
anxious. Shows agitation, 


overtly 


А 
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17. Conscientious à 
Bie ы : —v- Not conscientious 
E rer POR by truthfulness, hon- Мог too careful about right and wrong where 
y shr i t 
ness. own wishes are concerned, Not particularly just, 
a honest, ог unselfish. Inclined to somewhat shady 
A Е transactions. 
- Imaginative c -v- Unimaginative 


Has a ri i 

аз а rich and vivid imaginati Think ks imaginati 

туре oe agination. Thinks Lacks imagination. Approaches problems in a 
fon senate gles an aspects of a ques- literal matter-of-fact fashion. Unresponsive to 
ПИ ON Ive to a multitude of emotional the subtleties in a situation, 
= her possibilities not realized by the 
average person. 

19. Mark 

ке, oy — З $ i 
Date : Ош Interest in Opposite Sex — -v-Slight Overt Interest in Opposite Sex 
mice deal and/or talks a lot about Talks very little about women. Does not use 
om т. Extremely aware of women as opportunities for contacts with women. 
‚ (Disregard inferred needs or drives.) 

20. Frank 
= , —v- Secretive 
onis out readily with his real feelings on Keeps his thoughts and feelings to himself. 
кзн 5 questions. Expresses his feelings, sad 

Бау, саѕПу and constantly. 

21. 
Dependent Minded 
nt 
x ectnaliy dependent on others. Gener- 
A accepts the opinion of a group or of 

hority without much thought. 


—v-Independent Minded 
Thinks things out for himself. Examines every 
question persistently апа individualistically. 


Makes up his own mind. 


2 
[ 


- Limite : е 5 
"led overt, emotional expression —v- Marked overt emotional expression 
Shows hyperkinetic, agitated behavioral responses; 


Is a i $ 
pathetic, sluggish, or constricted. 
is overly excitable and over-demonstrative, 


Р Scale B (# 23-31) 


cale, 1 = left side ог low, 8 = right side or high.) 


(For ratings on this s 


1 
2 5 4 5 6 " 8 


Sing 
it zn many of the following attributes (3229-31) ате broad factors, it is unlikely that any person will 
of the phrases grouped together at one pole of a given variable. Note also that for some items, 


heitt sr ex е ; 

И хг extreme necessarily represents а desirable attribute. 

23a. ds 1 ^ 
Ability to develop and maintain warm interpersonal relation. 


2 
33b. Soci x LAM э 
od Adjustment: How well does he adjust to varied interpersonal situ 
adjustment only as it affects social adjustment in general.) 
Acts without consideration for feelings of  Actively considers feelings of others; readily 


Зете; often rejected by others, often ap- gains acceptance in interpersonal relationships; 
Pears aloof, hostile, or irritable. maintains a friendly and likeable manner. 


ships. 
ations? (includes sexual 


э, 
5 Appropriateness of Emotional Expression: How appropriate are his emotional responses to the 
Situation? 
s of a quality and in- 
tion; reacts spontane- 
shows well-integrated 


otional behavior. 


Fai е ; 
05 to adapt his emotional responses to the Shows emotional response 
aus of the situation; shows disorganized tensity befitting the situa 
Overly constricted emotional responses. ously but appropriately; 
and flexible patterns of em 


How intense is his inner emotional life as 


Chay, E k > 5 
ldracteristic Intensity of Inner Emotional Tension: 


infer 
Е, red from all available clues? 
d emotional life characterized by à Has strongly represst 
"imum of persistent internal tensions. ing in inner turmoil 
strong pent-up emotions. 


essed emotional drives result- 
1; great inner conflict and 
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; sie is-over:all adjust: 
26. Sexual Adjustment: To what degree do his sexual needs and activities affect his over ] 
26. Se i 
ment? 


i i ivities definitely en- 
His sexual needs and activities seriously in- His sexual needs aag i 
terfere with his over-all adjustment. hance his overall adjustmen 


А ы f a profes- 

ivati 1 : r is hi ^ the status rewards 0! 

27. Motivation for Professional Status: How strong is his drive for 
sional career? 


i str i iv vard acquiring 
28. Motivation for Scientific Understanding of People: How strong are his ane orae eS үке 
the facts, theories, and skills necessary for the scientific understanding of individua 


i Я Sé ions motivations 
29. Insight into Others: How much insight does he have into the attitudes, emotions, and 
of others? 


6 0f 
А “Өө namics О 
Interprets behavior at its face value; insensi- — Has good awareness of underlying he of be- 
tive to any but gross differences in behavior; behavior; is sensitive to subtle ee integrated 
does not develop any integrated understand- havioral responses; is able to uin йа 
i vi f anding of the behavior of pe . 
ing of behavior or of people. understanding ¢ 


insi i йү: ami f his own 
30. Insight into Himself: How much insight does he have into the underlying dynamics о 
attitudes, emotions, and motivations? 


31. Quality of Intellectual Accomplishments: What is the char 


ey Aiia ual 
‘acteristic quality of his intellect 
output? 


Intellectual work is characteristically of low 
quality. 


i: € york of 
Character cally produces intellectual wc 
high quality. 


Scale C—Criterion Skills (#32-43) 
(For ratings on this scale, 1 = low, 8 — high) 


T 8 
$ 4 5 6 7 
Ratings оп #33-12 refer to the subject's performance five years hence. 
What will be his level of competence or skill in the varied aspects of: 
32. Academic Performance: (during next three or four years) How well will he: lit 
Effectively master course content, successfully complete courses in general psychology, © 


er . pass 
psychology, statistics, and related fields; satisfy language requirements for the doctorate; | 
general examinations, 


l 2 


nical 


33. Clinical Diagnosis: How well will he: 
Recognize dynamics underly 
observe significant interrelati 
clinical data, 


fei ; y А $ х а istories; 
Elicit from the patient information required for mental status examinations and сазе Tu 
ascertain and evaluate attitudes and incidents of psychological significance in the patient. 


А Ж“ s : : struc- 
Synthesize clinical findings to picture of personality development, 
ture, and function. 


n — jective tests: 
ing particular responses in both objective and Јес Ае her 
onships among Tesponses, relate findings to case history an 


arrive at an integrated 


34. Individual Psychotherapy: How 


effectively will he: 
Conduct various types of indiv 


idual psychotherapy. 
35. Group Psychotherapy: How effectively will he: 
Conduct various types of group psychotherapy, 
Research: How well will he: 
Recognize and define important resear 
apply the research fin 
priate experimental des; 
results and conclusions 


oo 
> 


nd 
H fd: ае Е 
ch problems in clinic: А 


lings of others; think wi 8 


s i ri 
ign and statistical methods; grasp practical implications of findings, P 
in clear, comprehensive, and well-organized form. 

37. Administration: How well will he: 


al psychology; critically eval 


РЕ 
ей resp? 

Proper administrative decisions; ал morale 

bordinates and superiors; maintain hig 

ect an appropriate Public relations program. 


one 


38. 


39. 


40. 
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+ Integrity of Personal and Professional Behavior: 


‚ Over-all Suitability for Clinical Psychology: In view of his 
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РАВ РЕ” › Р. Р 
ше ыны Clinical Psychologists: How well will he: 
* Suy out the professional supervision of subordinates assigned to him for duty and on-the-job 
instruction; assign their duties; evaluate their performance; instruct them in clinical techniques; 


perform other aspects of in-service training. 


Reaching Psychology (in a College or University): How well will he: 
each college courses in general psychology: motivate students, present concepts and procedures, 
stimulate critical thinking about and integration of course materials, evaluate the products of 


learning. 
T rolassionn Interpersonal Relations: How well will he: 

ork cooperatively with superiors, subordinates, members of 
professional personnel concerned with the patient's welfare; 
Staff conferences; contribute to group decisions. 


the mental hygiene team, and other 
participate in.the give and take of 


How well will he: 

live up to personal commitments; show loyalty 
e or promise of personal gain; maintain 
form with commonly accepted stand- 


Recognize and fulfill professional responsibilities; 
n professional obligations in the event of outside pressur 
discretion concerning professional matters; appropriately con 
ard of moral and social behavior; refrain from coloring facts, evasion, lying, etc. 

assets and liabilities, how well will he 


be able to: 
Carry out the several duties, diagnosis, therapy, and research specified for the position of clinical 
Psychologist (P-4 and above) in the VA. 
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FOREWORD 


bec there has been considerable research on the over-all 
effectiveness of educational motion pictures, very little is known 
about their psychological impact on individuals. We know very little 
about how we communicate meanings by motion pictures. The de- 
sign of film scenes and sequences is left largely to the intuition of 
producers. Investigations of perception have covered some of the 
basic considerations in how meaning is conveyed by visual teaching 
materials but many experiments are necessary before we get sufficient 
clues as to how best to construct these materials. New techniques and 
new apparatus need to be developed for this research. 

This monograph describes one approach to this problem. The 
eye camera used previously in research in eye movements in reading 
was adapted for use with motion pictures. The camera is synchro- 
nized with the educational motion picture being viewed so that fixa- 
tions can be determined for each frzme of the teaching film. The 
eye-camera film moves intermittently, making a framed motion- 
picture record. This can be superimposed directly on the educational 
viewed by the subject. Eye dots can be located 
ture screen indicating exactly each eye 
ly made for slight head movements. 
hat a student looks at when viewing 


motion picture 
directly on the motion-pic 
fixation. Corrections are easi 
Thus we can quickly determine w 
a motion picture. 
This equipment 
for us to make analyse 
how they could be better 


make it possible 


and improvements on it may 
on pictures and 


$ of how we learn from moti 


designed to teach more effectively. 
Water W. Соок 


University of Minnesota 
December 1, 1950 
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DEVELOPMENT OF AN EYE CAMERA FOR USE 
WITH MOTION PICTURES* 


© 
І. Фуъһористіюм 


MEE pictures have come into wide 
use in the field of teaching and 
are destined for much more use. But ex- 
perimentation has, so far, merely in- 
dicated that they are effective, not why 
they are effective nor how this effective- 
ness is achieved. Furthermore, research 
has been concerned entirely with the 
Overall effectiveness of an entire film, 
not with the effectiveness of scenes or 
Sequences within the film. Yet the teach- 
ing value of an entire film is based on the 
teaching value of its parts. Within any 
Опе motion-picture scene, it is still im- 
possible to tell which elements are effec- 
tive in teaching and which are not. 

The determination of the effectiveness 
of parts of films will be of interest pri- 
Marily to educators who wish to exert 


more control over the translation of 
their ideas into motion-picture scenes. 
No one can tell, furthermore, whether 
the money and effort put into any one 
scene by the producer is justified by the 
actual learning accomplished in a class- 
room where the film is used. If such in- 
formation were available, large savings 
might be possible. 

Methods need to be devised to de- 
termine which elements contribute to 
the teaching value of the film and which 
do not. One line of attack is to adapt the 
eye camera used in measuring eye move- 
ments in reading to measuring eye move- 
ments while pupils are looking at educa- 
tÓnal motion pictures. This paper 
describes this method. 


II. CRITERIA FOR A METHOD OF MEASURING EYE MOVEMENTS 
OF SUBJECTS VIEWING MOTION PICTURES 


HE eye camera had to satisfy the fol- 
lowing criteria: 

1. It must provide a record of both 
Vertical and horizontal eye movements 
Оп one film. 

3. It must move the film intermit- 
tently as in a motion-picture projector, 
ṣo that the resulting record can be pro- 
J€cted directly for analysis. 


* 
Es apparatus herein described was devel- 
Bene. as part of a study conducted under the 

ious guidance of Dr. Walter W. Cook. Dr. 
брен Tinker contributed from his [pos 
Original «= in analyzing cye movements. The 
ion 141 eye camera that is here adapted for ma 
Brang tures was developed by Dr. Herman R. 
and we Mr: Peyton Stallings, Miss Dolores Paul, 
assist; Irs. Evon Unruh contributed invaluable 

ance, 


9. It must operate as nearly as pos- 
sible at the projection speed of educa- 
tional motion pictures (24 frames per 


second). 

4. It must p 
for the subject so t sit 
ing the teaching film will be as 


rovide maximum comfort 
hat the situation of 


view. 
nearly natural as possible. 


A. TYPES OF Evr-MovEMENT MEASURES 


Obtaining eye movement measures of 
subjects looking at motion pictures dif- 
fers in several important ways from ob- 


taining eye-movement measures during 


the process of reading. 


Not all the measures of eye movements which 
are useful in reading seem to be applicable to 
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the viewing of motion pictures. The measures 
of eye movements are: (a) pause duration, (b) 
span, (c) fixation frequency, and (d) regression 
frequency. Tinker (6) has stated that of these, the 
two most closely associated with reading ability 
are fixation frequency and Tegression frequency, 
and that pause duration is one of the worst 
measures of reading ability because it varies so 
much with the type of reading material. 

Regression frequency cannot apply to pictures, 
cither still or motion, because pictures are not 
read from left to right or in any standard direc- 
tion as in reading, even though Brandt (1, р. 57 

- has found a slight tendency for the eyes to make 
more fixations in the upper left quadrant in 
viewing symmetrical designs, 

Fixation frequency would probably not be a 
very good measure of eye movements with mo- 
tion pictures because of the constant speed fac- 
tor in motion pictures. Sound films move at a 
speed of 24 individual frames per second, and 
the average motion-picture scene lasts only 6 


seconds. In .à good teaching film, individual 
scenes follow each other in ve. 


Putting pressure on the viewer to assimilate as 


the time allowed, 
ve the viewer time 


gh it might prove to have 
pioneering experi- 
plore the field, 
The two measures that remain, span 
and pause duration, seemed to be the 
best to use in this experiment, Although 
Pause duration, as mentioned above, has 


ures of reading abili 
theoretical basis th 
More useful as а 


type which is com 
er in one fixation by the use of periph- 
eral as well as foveal vision. Such a 
concept in viewing pictures would not 


be useful in these early stages of research 
on pictures. A comparable measure, 
however, would be the lincar distance 
in an= “rection traveled by the eye be- 
tweé any two consecutive fixations. It 
was decided to call this distance 
interfixation movement, to distinguish 
it clearly from span. 


Mention should be made here of the — 
turn sweep" which is used in reading rese ae 
It refers to the movement of the сус in py oe 
from one end of a line of type which has 5 E 
read to the first fixation on the next line of LE 
Because the term return sweep has such HE on 
cialized meaning connected with the lines с Rm 
it was decided not to apply it to viewing pic 


The method of recording eye we 
ments, therefore, should be capable a 
giving fairly exact measures of interfix 
tion movement and pause duration. 


wo- 
В. Neep or Locating Fixations IN Т 
DIMENSIONAL PLANE 


The measuring method needed als? 3 
tell where the eye is fixated in a "hd 
dimensional plane perpendicular «^ is 
line of vision, In reading research, t 
usually sufficient to measure the poni 
movement of the eyes from left to кы 
In viewing pictures, it is necessary [ges 
cate these fixations on a ichs pem 
plane by measuring not only the lat ve- 
movements, but also the vertical mo 
ments, simultaneously. 


As 
C. Evr-CAMERA Speen As NEAR iE 
POSSIBLE то Twenty-Four FRAM 


PER SECOND i 
- measu 
If an eye camera were used for meas" 


І x - OS) 
ing the viewing of motion picote inn 
would be especially useful dien 


at 24 
advanced through the eye camera d that 
frames per second, the same spee the 


й > : : оп 
the motion picture is projected п were 
Screen. If at this speed each fixatio 


Ё 
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represented by one dòt in two dimen- 
sions in a frame of the film, then the eye- 
camera film would have a one to one 
relationship to the teaching fun being 
Viewed. It would be possible; this 
ideal situation, to project the eye-camera 
film on the screen, thus superimposing 
the actual fixation dot on the motion- 
picture scene which caused this fixa- 
поп. 


It seemed at the beginning that it might even 
be possible, ideally, to project the суе-сатсга 
record in some instances by a motion-picture 
Projector, superimposed on the screen on the 
teaching film image which, of course, would also 
be run in synchronism in a motion-picture pro- 
jector. The effect on the screen would be that of 
а moving fixation dot, moving about on the 
Screen exactly in the same Way in which the 
subject viewed the teaching film. If such a 
method could be developed, it would even be 
Possible to synchronize several projectors and 
contrast or compare the fixations of several sub- 


jects selected as typical or atypical from a particu- 
lar point of view. In practice it was found that 
this ideal of making eye records at 24 frames per 
Second and projecting them їп a motion-picture 
Projector could not be realized owing to the 
limitations of cameras now available. A compro- 
mise speed had to be accepted, and the motion- 
Picture projection of cye records deferred to a 


later experiment. 


III. METHODS OF MAKIN 


IX standard corteaL-reflection type 
of eye camera produces a record on 
35-mm. film consisting of a series of dots 
closely spaced. The film is not moved 
intermittently as in а motion-picture 
camera but continuously as in a smoked- 
paper tracing. 
‚ Buswell (2) measured eye movements 
11 two dimensions during viewing of 
Pictures by using two recording films at 
right angles to each other moving Syn- 
chronously and continuously. Analysis 
Was made by computation. 


The camera developed at Purdue Uni- 
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D. COMFORT OF THE VIEWER 


Another very desirable criterion of a 
machine for measuring eye movements 
with motion pictures was the comfort of 
the viewer. The basic reason for this was 
that printed words are symbols, whereas 
motion pictures are close to reality. 
Reading is, therefore, expected to be 
done in a somewhat constrained physical 
position, whereas the viewing of motion 
pictures allows considerable freedom of 
movement. 

It was also necessary to make the eye- 
movement records in a room with sub- 
dued light, since the subjects would be 
viewing motion pictures. To view mo- 
tion pictures in a room even partially 
illuminated would ruin any effective 
realism which the motion picture might 
be trying to create. 

Finally, it was desirable to find a 
method of making eye-movement records 
hich would not involve shining too 
bright a light into the subject's eyes, 
because this would be especially trying 
when the subject was looking at motion 
pictures in a darkened room. 


G EYE RECORDS 
versity is simply an 8-mm. motion-pic- 
ture camera taking pictures of the sub- 
ject's eyes reflected in a half-silvered mir- 
ror. Trained analysts can tell at which 
large area of the material the subject is 
looking. The method lacks the exactness 
of the corneal-reflection type of camera 
but is quick and useful for such tasks as 
analysis of effectiveness of advertising 
layouts. ` 
The camera developed by Dr. Herman 
F. Brandt uses а 35-mm. motion-picture 
camera moving the film intermittently to 
photograph the corneal reflection. It pro- 
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FIGURE 1, The eye camera, 


duces а two-dimensional record on 


m. Head movements are also 
recorded on the film. 


This camer 


а came closest to meeting 
the criteria, 


It makes a framed motion- 


IV. ADA PTATION 


NUMBER of minor 
Brandt camera 
chang: 


changes in the 


nents of subjects 
looking at motion pictures, 


picture record which can be undue 
projection in a filmstrip projector , of 
out computation, It has the — ae 
the corneal reflection type. It does 


need bright photo raphic lights. 
Б бта} 


OF THE BRANDT CAMERA 


А. INCREASE IN CAMERA SPEED 'andt 

The normal speed of the грае 

camera is ә frames per second. ethod 

the original plan to devise some id take 

of eye Photography which wou nd 50 
Eye records at 24 frames per seco 
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that the resulting picture could be pro- 
Jected ina motion-picture camera, super- 
imposed on the screen over the teaching 
film. It was clear that the Brandt camera 
mechanism could not be speede 12 
times. The mechanism would not stand 
the strain. 

It was possible, however, to speed the 
camera up to some extent. The motor 
drive of the camera was synchronous, 
and the motor itself contained a 3 to 1 
reduction gear. By removing this gear 
and attaching the motor drive directly 
to the secondary gear box, the camera 
Speed was increased from 2 frames per 
Second to 6 frames per second. This was 
the maximum speed possible with this 
camera, and it was decided to settle for 
this, as such a speed would be ample to 
register most fixations with even the 
Shortest possible duration. 


B. INCREASE IN CANDLE POWER OF 
» CORNEAL LIGHT 
The corneal light sources 
mounted in lamp houses on brackets on 
either side of the camera. A beam of 
light aimed at the eye was formed by a 
fine horizontal slit in the lamp housing. 
Only the right-hand light was actively 
used in the experiment since it illumi- 
nated both the cornea of the right eye 
and the surface of the false eye near the 
Might temple. The left-hand corneal light 
Was beamed at the left eye because it was 
More comfortable for both of the sub- 
Ject’s eyes to be illuminated approxi- 
mately evenly rather than to have one 
in darkness. 
Xl camera came eq | 
Bind. 4 light source ofa 1,183 ле 
fue d a light intensity of 39 € ас 
up ma When the camera Was — 
to » it was necessary to obtain more lig t 
expose the photographic film, since 


were 


uipped with a 
adlight, 
andle 
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the tripling of the camera speed reduced 
the exposure by one-third. Therefore, 
the right-hand corneal light was replaced 
with a 50 candle-power bulb of the same 
type. The left-hand corneal light source 
was left at зо candle power since the im- 
balance in illumination on the two eyes 
was not noticeable to the subject. 


C. CHANGE ОЕ Tyre or FALSE EYE 

As mentioned previously, the camera 
makes provision for registering on the 
film the reflection from a false eye. This 
was a chromium bead attached to a pair 
of empty spectacle frames. Preliminary 
tests showed that approximately 10 
minutes would be required to fit the 
spectacle frames to each of the subjects 
as they varied in physiognomy; there- 
fore, the frames were replaced with a 
light earphone head clip to which 
attached a chromium cap screw. 
This cap had greater curvature than the 
chromium cap on the spectacle frames, 
and therefore produced a smaller false 
eye dot on the motion-picture film. It 
was attached to the earphone head clip 
by two inches of lead wire which was 
be bent easily. Thus, it 
was easy to adjust the false eye into the 
optimum position for each subject. Sub- 
jects with broad skulls often required the 
bending of the false eye toward the right 
eye so that they would not be too far 
apart to register on the ground glass of 
the camera at the same time. 


very 
was 


soft enough to 


D. ADAPTATION OF VIEWING ANGLE TO 


Motion PICTURES 

Dr. Brandt’s camera was supplied with 

a mount for copy approximately 215 
feet in front of the subject's eyes and 
parallel to the plane of the motion-pic- 
ture film. When the camera was used 
for this purpose, its natural position al- 
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lowed the subject to look downward at 
an angle of approximately 30 degrees 
to look at the copy. 

' Even though it would have been pos- 
sible to project the pictures on the ad- 
vertising copyholder simply by using a 
white sheet of paper as a screen and 
focusing the projector for a very short 
throw, it was decided not to project the 
teaching film on a very small screen. 
When motion pictures are viewed in a 
reduced size at close range, even though 
the angle of view for the eyes is exactly 
the same as it is for a larger screen 
further away, the realistic effect of the 
motion picture is lost, probably because 
the necessity of focusing the eyes at short 
range makes the subject fully aware that 
he is not looking at even a close imita- 
tion of reality. When motion pictures are 
projected on a small Screen, they give 
the impression of a peep show. On the 
other hand, if pictures are projected су 
à comfortable distance of 10 feet or more 
away from the subject, he is able to get 
Somewhat of an impression that he is 
looking at a real Scene and project him- 
self into the picture. The Society of Mo- 
tion Picture Engineers (5) 
well-established standards fo 
in relation to the viewer in any room 
used for the Screening of motion рїс- 
tures. The standard States that no seat 
in the auditorium should be nearer to 
the Screen than twice the width of the 
Screen and no seat should be farther 
from the screen than five times the width 
of the screen. 

; Motion pictures are normally pro. 
Jected so that the Subject's line of sight 
is approximately 10 degrees above the 
horizontal. To adapt the camera, there- 
fore, for viewing motion pictures, the 
magazine rack was removed, the camera 
was elevated about a foot above the 


has set up 
т Screen size 


height in which-it was normally used, 
and it was tilted down toward the sub- 
ject. The front half of it was hinged e 
the table, in order to provide stability. 
Un?” the back of the camera, a v 
ше ooden wedge was placed. By 1п- 
serting or withdrawing this wedge, me 
angle of the camera could be i 
to the individual subject. The result wa 
that the reflected beam of light from the 
cornea entered the lens tube of the 
camera more horizontally and at abor 
the same angle of reflection as it did 
formerly. | hly 

By extending the sight lines rough) 
from the subject's eyes past the real 
rack to the wall, the comparable size 0 
the screen was determined. It was Te 
duced somewhat to be safely within the 
standards of the Society of Motion Pic 
ture Engineers. It was not reduced more 
than absolutely necessary because e 
camera Was designed so that the maxi 
mum movement of the subject's eye» iN 
swinging from one side of the copy Lo 
to the other was within, and yet or 
completely, the area of the eye-camer 
Motion-picture frame. When the size 0 
the screen had been determined, it ме 
checked by actually placing a subject е: 
front of the eye camera and turning ae 
the corneal lights, positioning and ae 
ing the camera, and then asking the sv 
ject to sweep his eyes to each of the vem 
corners of the screen in succession Whi t 
the experimenter checked the moveme? 
of the fixation dot on the reflex groun 
glass of the camera. The movements E 
the fixation dot were found to be Jas 
Within the limits of the ground? 
aperture, The final size of the screen k J 
33” х 44” and the distance from the $" 
ject to the screen was 8 feet. ach 

In order to keep the subject as и. 
at ease as possible, plenty of foot ! 
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was provided by placing the camera on 
a small go" x 40” table which provided 
clearance for the knees. As the subject 
Was to be photographed in a ¢lightly re- 
dining position, the ability end 
his legs forward contributed considerably 
to his comfort. Since the camera was 
quite narrow, the subjects arms were 
placed on the sides of the table on either 
Side of the camera in a relaxed position. 


E. USE or AN ADJUSTABLE CHAIR 


Preliminary tests with the camera 
showed that, if the subject merely pressed 
his head against the curved support pro- 
vided for the forehead and against the 
brace provided for the chin, the eye 
records showed excessive head move- 
ment. In spite of a desire to give the sub- 
ject all the comfort possible in order to 
get as nearly a natural reaction to the 
Motion picture as could be obtained, it 
Was decided that some sort of headrest 
Must be provided. At the same time, it 
Was clear that either the sübject's chair 
or the camera would have to be mounted 
9n a lifting device in order to provide 
quickly the close vertical adjustments 
when each student was first seated. (The 
fine adjustments were made in the 
Camera itself) The ideal subject chair 
Was found in a standard dentist chair 
Operated by hydraulic lift. This type of 
chair has so many adjustments on it that 
It was possible to seat the subjects 
quickly and exactly in front of the lens 
tubes of the camera. The arms of the 
chair had been removed so that it could 

е slid under the table. Once the subject 
Was seated, the back rest of the chair was 
brought up to provide a firm support for 
the subject's back and to make him sit 
Upright so that it was impossible for him 
19 change the level of his eyes by slump- 
Mg in the chair. Then the hydraulic lift 


was used to bring the subject's eyes up to 
the level of the lens tubes so that the 
narrow beam from the corneal light was 
exactly centered on the cornea of the 
right eye. With the hydraulic lift, a very 
fine adjustment was possible so that the 
corneal light did not have to be adjusted 
more than a fraction of an inch. 


F. INSTALLATION OF BITE STICK 


In the matter of the headrests, several 
tests were made. The headrest attached 
to the camera included both the chin 
rest and a place to insert a bite stick. 
Following the principle of using the 
least constrained position on the sub- 
ject, some eye records were made with 
subjects merely resting their chin in the 
chin rest and pressing their forehead in 
the forehead rest. It was quickly found 
that the chin rest forced subjects with 
long chins to keep their heads higher in 
бле headrest than normal, with the re- 
sult that the curved band of the forehead 
rest sometimes came down over their eye- 
brows, partly obscuring their vision. Sub- 
jects with short, round faces found that 
the forehead rest (which was not adjust- 
able) came too far up on the forehead 
to provide firm support. Even in small 
samples of subjects, it was inevitable that 
different face shapes would be en- 
countered. "Therefore, the chin rest was 
abandoned. The only alternative was to 
use the bite sticks. These were round, 
wooden sticks % inch in diameter and 
approximately 6 inches long, obtained 
from a candy factory. A supply of them 
was sterilized and kept on hand, a new 
eing used, of course, for each sub- 
ject. They were inserted into the ma- 
chine between two metal supports. Al- 
though it seemed unfortunate to intro- 
duce such an artificial situation as biting 
on a stick while viewing motion pictures, 


one b 
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Fic 


it must be admitted that the bite stick 
did provide а very firm Support and 
eliminated completely any rotating or 
Further- 
ange the bite 
€ stick at the 


to move his head slight] 
backward, rotating in а 


URE 2. Close view of subject ready for making eye movem 


ent records. 


ould 
by means of two small pads. I m 
be adjusted very snugly ават» наху 
ject. Some subjects in the oe the 
tests complained that the steel o cold 
forehead rest was uncomfortably thin 
and hard, so it was covered with whe [o 
layer of sponge rubber and a lay 
gauze. 


С. Tue Curing LIGHT 


чиге 
In the camera there was an aie 
Several inches to one side of di pal a- 
graphic aperture in which a ufi area 0 
light bulb could expose a sma is The 
the film through a Vg-inch аралай таке 
Purpose of this cueing light was t at the 
an identifying mark on the een be 
moment when a particular test 
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ginning. Thus the camera could be put 
Mto operation some time before signifi- 
cant cye-movement measures were to be 
taken. When the actual test sit 
curred, the cueing light could bs К 
to mark the spot on the film. Laté?in 
the analysis of the film, an allowance 
could be made for a standard number of 
frames between the cueing light and the 
camera aperture so thac the first eye- 
record scene could be accurately 
identified, Eye-movement records were 
to be taken when the subjects viewed 
Certain scenes of a teaching film. It 
Would be necessary to mark a definite 
stant frame on the test film at the begin- 
ning of each scene. At the same time it 


Ficure 3. Detail of cu 


was necessary to flash the cue light in 
the eye camera so that in the eye-record 
film it would be possible to identify the 
particular frame where the subject began 
looking at the test scene in the teaching 
film. It would not be reliable to do this 
manually, i.e., to have the experimenter 
close the switch for the cueing light when 
the first frame of the motion picture 
came on the screen, because the reaction 
time of the experimenter could make a 
considerable error in locating the start 
frame when the motion picture would be 
going by on the screen at the rate of 24 
frames per second. 

For this reason, a device 
structed on the motion-picture projec- 


was con- 


i ion picture projector. 
1eing device on sound motion р p 
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tor so that the teaching film itself could 
activate the cueing light on the eye 
camera. It was decided that this cueing 
light should be activated and the cue 
_Mark put on the film exactly 40 frames 
before the start frame of each test scene. 
Forty frames were accurately measured 
on the bench and the frame for the 
activating device marked with a red 
8rease pencil. At this point before each 
test scene three small pieces of tin foil 
were attached to the sprocket edge of the 
film by means of film cement. Three 
were considered essential in case one 
failed to activate the cueing light. These 
three marked frames passed through the 
sound projector in % of a second. A 
small pilot light was wired into the same 
circuit with the cueing light and at. 
tached to the motion-picture projector so 
that it would flash every time the cueing 
light flashed in the eye camera. In this 
Way, the experimenter was certain thot 
the cueing device had Operated and that 
the flash frame had been put at the be. 


ginning of every subject's eye-camera 
record, 


Н REGISTRATION Dots 


Tt was necessary as usual in all eye- 
camera records to obtain several stand- 
ard fixations at the beginning of each 
Cye-camera record which Serve as regis- 
tration points for the Subsequent anal- 
ysis of the Sye-camera record. This is 
customarily obtained in reading by first 


definite 
Sequence, usually upper left, upper right, 
lower right, and lower left, These fixa. 
tions appear in the photographic record 
of the eye movements and make it pos- 


sible for the experimenter to estimate 
closely where in the copy the reader Was 
fixating at the time he made any partic- 


ulayfixatipn dot. ^ 
ri ./@perimentation on motion pic 
т 


tug 1t is even more important to have 
the’ same registration dots in order to 
locate the fixations in two dimensions 
and to determine the necessary enlarge 
ment of the eye-camera film when it is 
analyzed by projecting it on the sereen 
Therefore, a special strip of film was 
photographed on a title board, ае 
veloped, and attached to the beginning 
of the test film. In this scene the registra- 
tion dots appeared one by one in ше 
usual sequence, starting at the upper 
left and ending at the lower left. The 
dots were placed some distance in Шо 
the edge of the frame so that imaginary 
lines connecting them would enclose 
three-fourths the area of the frame. 
Thus, the first thing that the exper 
mental subject saw on the screen wae 
these four dots. Before the test film E 
started, part of the instructions to p 
subject was a warning that these pu. 
would appear and to fixate on each on 
as it appeared. 


ERA 
І. PRELIMINARY Trsrs ОЕ THE CAME! 


It was evident from the foregoing d 
Several weeks were spent in adapting t! z 
Brandt camera to use with motion qe 
tures. References have been made M 
continual tests of the operation of ES 
Camera, sometimes employing ока 
ing individuals and sometimes even -—— 
ing actual eye-camera records. et А 
when all the above changes had cdi 
made, fairly complete eye-camera oe т, 
Were made from three volunteer € jon 
to make a thorough test of the ope! m : 
of the machine and to set up the pc 
nique and procedure of the subsed 


m 
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analysis : 
g alysis of the eye-camera film records. 
evera { 

veral hundred feet of 35-mm. film were 


exp i i 
posed in the eye camera while the sub-- 


Jects were looking at various nf. Mic 
tures. The resulting film was n. ed 
and analyzed frame by frame. Рап dar 
beu paid to the clearness of the 
is ome to the movement of the false 
BF d bs — registered head movement 
Showed P oject. These preliminary tests 
dependable, the cueing device was not 
ad anle: enough, and it was rede- 
Miles дк is operated perfectly. Dr. 
Sues E. "s er was invited. to examine 
ih t Ө еуе records projected on the 
Chi ale it was his opinion that the 
inu: was feasible. These tests also 
ee tus experimenter a number of 
n о to be taken, such as keeping 
Mitis ject restrained in the eye-camera 
ан no longer than was absolutely 
Potion. giving plenty of time to get 
fors ned to the two corneal lights be- 
giving the test film, etc. 


USE 


WITH MOTION PICTURES 11. 


J. Tue RELIABILITY AND VALIDITY 
OF THE METHOD 

The method described above of meas- 
uring eye movements is fundamentally 
the same as that employed by Langford 
(4) and Buswell (2). Buswell tested the 
validity by having subjects look very ac- 
curately at a series of five dots placed at 
intervals of 1 inch in both the horizontal 
and vertical planes. Forty-seven subjects 
then plotted these known fixations. He 
found that the error was 1 per cent in 
72 per cent of the cases, and less than 3 
per cent in 91 per cent of the cases. Al- 
though Buswell did not compute the 
reliability statistically, it seems that the 
level of error is extremely low. Wey- 
mouth and others (8) have found that 
the central axis of the eyeball and the 
line of regard approximate each other 
within 22 minutes or less. In addition, 
Dodge (3) has shown that the corneal re- 
fection method is a reliable index of the 


position of the eyeball. 


V. THE MAKING OF EYE-MOVEMENT RECORDS 
IN THE LABORATORY 


| VHE typical procedure followed in the 
eye-camera laboratory with each 


"ect is as follows: 
Tre the subject enters the room, the eye 
comple is loaded with sufficient film to run the 
Беде б test on that subject. The camera is 
Series кү ГОМЕ the film mechanism, and a 
to indi Circular punch marks are put in the film 
camer: icate the number of that particular eye 
E record, This is entered in the log book. 
camera’ sterile bite stick is inserted in the суе 
1 Та headrest. 
16. те teaching fi 
threading ne projector. Special care d 
9 make g the film through the cue-mark device 
cue-mark qe that it activates the mechanism. The 
Actual st evice is placed 40 frames ahead of the 
lesteg xu. frame of each of the sequences to be 
Clow. Gee to make sure that the lower loop 
tienden Picture. gate of the projector is 
to exactly the right size, two punch 


Im is threaded into the 
is taken in 


ave been placed in the leader of the 
o frames apart. The film is there- 
ch marks 


marks h 
film exactly 4 
fore threaded so that one of these pun 
is located exactly in the picture-projection gate 
and the other punch mark is centered in the 

cueing aperture. x 
When the subject enters the laboratory pro- 
jection room, his name is obtained, checked off 
on the group list, and entered in a record book, 
k, opposite the number of the 


called the log boo! c 
Im and the number of the "take" in the 


ained to the subject that he is 
to be shown a motion picture and at the same 
time the eye camera is going to photograph the 
movements of his eyes as he watches the picture. 

After the subject is put at ease, he is placed in 
the dental chair which is adjusted to support his 
back firmly. Then the elevator mechanism raises 
him exactly to the point where his brow fits into 
the forehead rest and he is able to bite the bite 
stick comfortably. Then the head clamp is 
brought up from behind and adjusted as tightly 


roll of fi 
camera. It is expl 
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as possible without hurting the subject. It is ex- 
plained to the subject that it is necessary to hold 
his head just as firmly as possible but that he 
must speak up if the head clamp is so tight that 
it hurts. The false eye is then placed over the 
subject's head. 

At this point the lights of the room are turned 
out. One assistant takes the position in front of 
the screen and holds a small pen light exactly 
in the center of the screen area. The other assist- 
ant then proceeds to adjust the eye camera to the 
subject. He asks the subject to keep his eyes fixed 
on the pen light on the screen, Then he places 
another pen light over the ground-glass area 
so that its beam Projects through the camera in 
а reverse direction from normal and casts a small 
spot of light near the subject's eye. Then the 
camera is adjusted by knobs to raise it and move 
it laterally until this light is centered exactly on 
the subject's left eye. 

The corneal lights are now turned on. If their 
beams do not exactly hit the eyes, they are ad- 
justed individually by loosening the rods that 
support them. The adjustment of the light into 
the left eye is only approximate but the right 
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one is more carefully centered. The subject 15 
then asked to look again at the pen light in the 
middle of the screen and finer adjustments are 
made on the camera. The corneal reflection Ж 
cesed сту:сПу at the crosshairs in the d 
glag n ture and then focused to as n ye 
as „29? a dot as possible by means p e 
Гос ig screw. As a final test, the subject is A 
asked to let his eyes roam around the screen a 
finally return to the pen light in the center. Т ei 
action of the corncal reflection spot (later pe ed 
the fixation dot) on the ground glass is noted 1 
see that it moves only a normal distance to each 
side of the crosshairs. " flec- 
The false eye is now adjusted so that its xs 2 
tion dot appears in one corner of the B5 rnit 
glass. It is adjusted by manually bending the S 
wire support on which it is attached to the hea 
clamp. icture. 
The subject is now ready to view the pictu ма 
Не is warned that the first thing he will sce on 
the screen will be a series of four dots at the Por 
corners of the screen in the following € 
upper left, upper right, lower right, and edm 
left. One of the assistants. illustrates by holding 
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the pen light in these corners of the screen be- 
fore the film is started. The subject is instructed 
to look at these four dots carefully. After that 
he is to view the picture in an entirely normal 


fashion as he would any motion pictur> The - 
; S 

Ject is asked to rest his hands comfoy n 

cach side of the table or fold them in [rg , 


whichever he desires. It has been prety Sly 
pointed out that there is plenty of leg room 
under the table for the subject to move his feet 
any way he wishes. During the running of the 
film and the eye camera, one assistant remains 
Within reach of the eye camera and the subject 
although keeping out of the subject's range of 
Vision, He watches the subject to see if there is 
any unusual reaction to the situation which 
might invalidate that subject's record. 

, Fhe other assistant remains beside the motion- 
Picture projector and controls both the pro- 
Jector and the operation of the eye camera. 

H The motion-picture projector is now started. 

The volume control of the sound-reproduction 
Mechanism is turned as low as possible because 
the film leader containing the four orientation 
dots consists of silent-film stock. If this were 
allowed to go through the sound apparatus with 
the sound turned on, the perforations on the 
Sound-track side of the film would cause a dis- 
tracting noise known as “motor-boating.” As soon 
^5 the four orientation dots have passed, the 
Sound volume is turned up and the film is 
allowed to run then normally without interrup- 
Чоп until the last test sequence has passed. 

The operator of the projector is warned of the 
Approach of a test sequence in cach case by three 
Small bits of white adhesive tape fastened to the 
SProcket-hole side of the film. The appearance 
9: these Boing through the projector mechanism 
"icates that the cue mark preceding the start 

rame of the test sequence by forty frames is not 


VI. ANALYSIS OF T 


W= the film is unloaded in the 
darkroom, the punch marks in the 
vill not 


Im are located by touch so they Y 
20 lost with any clipping of the ends 
of the roll, The film is developed by 
к in a Stineman spiral tank эйе. 
im ng D-72 developer and developing © 
age 4 to p minutes. This ume was 
sag iously determined by developing test 
PS from the camera for vaTyns 
prof time to get the utmost density 


Wit 
hout too much fog. 


more than five seconds from the cue-mark gate. 
At the appearance of these white bits of tape the 
operator turns on the eye camera. This allows 
a safe margin so that when the silver foil activat- 
ing the cue-mark mechanism goes through the 
cue-mark gate of the projector, the eye camera is 
sure to be running smoothly. At the same time 
the cue-mark light is activated in the eye camera, 
the small neon light connected in the same cir- 
cuit flashes beside the projector so that the 
operator knows that the cue-mark light in the 
camera actually has been turned on. Several 
seconds after the test sequence has ended, the 
operator turns off the eye camera. The camera is 
restarted at the beginning of each test sequence 
in the teaching film. 

As soon as the final'sequence has passed and 
all the eye records are obtained, the motion-pic- 
ture projector is shut off. Then the eye-camera 
operator quickly opens the reflex gate on the 
camera which allows the eye dot and the false 
eye dot to appear on the ground glass, and checks 
them for position to make sure they have not 
moved off the field. The subject is released from 
the head clamp and bite stick and allowed to sit 
back in comfort to view the rest of the film. As 
soon as the film is finished, the lights in the 
room are turned on. 

The footage meter on the eye camera is then 
cl/':cked to make sure there is enough footage for 
the next subject. (Usually three eye-camera rec- 
ords can be placed on a 200-foot roll.) Then the 
camera is turned on for a moment in order to 
allow some blank film between the two adjacent 
eye records. The 16-mm. projection film is re- 
wound and rethreaded ready for the next sub- 
ject. The film in the camera is punched with the 
next number of punch holes and entered in the 


log book as before. 
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development, each subject's 
record is identified within each roll by 
its punch numbers, and the name of 
the subject is scratched into the film with 
a sharp instrument. Then the film is 
cut to separate each subject's eye records. 
The individual rolls are wound up on a 
stripped off, and held together 
Tape on which the 
s written with red 


After 


flange, 
with white Scotch 
ject i 
name of the subjec 
rease pencil. The rolls are all wound 
fread out. That is, the orientation frame 
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is always on the outside of the roll. The 
rolls are then stored in 1,000-foot 35-mm. 
film cans which are sealed and tem- 
porarily placed in a film vault: 

The next step is to locate on the 16-mim, 
print of the teaching film the exact be- 
ginning and ending of each of the test 
sequences. These had been roughly de- 
termined before the cueing material was 
affixed to the Projection print, but now 
they are located exactly to the individual 
motion-picture frame. This is designated 
as the "start" frame. It is then necessary to 
locate the corresponding start frame in 
each eye-camera record. The first step in 
this process consists in determining the 
number of frames between the 16-mm. 
Start frame and the cueing frame. This 
distance is determined for all test se- 
quences and listed in the log book as “cue 
mark plus 4o frames,” “cue mark -plus 
200.” After these standard distances are 
entered, it is necessary to transpose Ш 
to the eye-camera film. Since the eye 
camera runs at 6 frames a second while 
the projector runs at 24 frames a second, 
the distance on the eye-camera record be- 
tween the cue mark and the start frame 
is always one-quarter of the same distance 
on the projection print. 

Thus, the Projection print is used to 
determine the start frame and then, by 
counting backwards, the distance to the 
cue mark. This distance is divided by 
four and measured out on each eye- 
camera record starting with the cue-mark 
frame to locate the corresponding start 
frame on the eye-camera record, 

The 16-mm. print is also used to deter- 


mine the length of each test 
measured 
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frames on each eye-camera record, the 
different distances are laid out on a scale 
on a work bench. By using this, the start 
frames fox each of the sequences in each 
еу td can be measured and marked 
Ача 7 and accurately. The start frames 
are'indicated on the film by outlining the 
frame and marking it with an X with 


‘a red grease pencil. Furthermore, the 


two frames preceding each of the start 
frames are marked with a red arrow 
pointing toward the tail of the film and 
indicating the number of the sequence 
whose start frame follows immediately 
after the arrow, 

Two measures are read from these eye 
records: the amount of saccadic move- 
ment and the pause duration. On Dr. 
Tinker’s advice, it was decided to call 
the amount of saccadic movement “inter- 
fixation movement." The term “sweep’ 
cannot be applied because this refers to 
movement of the eye in reading in re 
turning from the end of one line to the 
beginning of the next, The term "span 
cannot be used here because this has 
been used specifically to refer to the 
number of words in reading compre- 
hended in one fixation point. It was 
thought best, therefore, to use the term 
"interfixation movement" as applying (0 
the straight-line distance between two 
fixations in viewing pictures of two di- 
mensions. 

It was decided to use the unit 1/24 of 
а second as the basic unit in measuring 
pause duration, simply because ап em- 
Pirical study of the eye records in а 
Pilot experiment had indicated that 
there would be no pause durations 
Shorter than this. А 

For convenience, two graph-paper dai 
books are used in recording the inter- 
fixation range and the pause durano 
for each subject, Half of a double pag 


AN 


Ficure 5. The laboratory analysis of ey 


15 assigned to each subject. Successive 
rows are labeled according to sequences. 
Vertical columns are numbered from one 
upwards to indicate frames out of the 
eye-camera film record. 

The method used in reading the two 
Measures of eye movement is to thread 
the eye-camera film into а 300-W. air- 
Cooled filmstrip projector and project 
the film frame by frame on а fairly large 
Screen, The projector is ftted with a 
Single frame attachment 50 that only 
one frame of the film record is analyzed 
E. time, without any possibility of con- 
en Because the eye camera moves 
cam Im horizontally through the с 

ега aperture, the eye-camera records 
ела projected ina filmstrip pro- 
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e-movement records 


jector which will similarly move the film 
from left to right through the filmstrip 
aperture. The distance from the projec- 
tor to the screen, technically called the 
throw, is unimportant because there is 
no interest in the absolute movement of 
the eye which can only be measured in 
spherical angles; to be measured is the 
relative movement measured linearly on 
the plane of the screen without reference 
to the direction of movement. The rela- 
tive eye-movement measures provide the 
data for the measurements of association 
between eye movement and other experi- 
mental factors. 

It might be supposed that greater ac 
curacy in measuring the interfixation 
movement might be obtained by moving 
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the projector farther away from the 
Screen since this would enlarge all the 
details on the screen. However, such 
great magnification is not useful because 
the factor limiting the accuracy of meas- 
urement is the sharpness of the image 
of the fixation dots on the film. 

The screen consists of a piece of matte- 
white screen fabric fastened over a sheet 
of cork mounted on a solid frame. The 
cork is necessary to allow several pins to 
be stuck into the projection surface at 
one time. It is necessary to darken the 
Toom only partly because the powerful 
projector shining through the almost 
clear eye-record film produces a brilliant 
image on the screen, 

Two assistants are necessary to oper- 
ate this equipment. One assistant re- 
mains seated at one end of the room 
beside the filmstrip projector. Her part 
is to thread the individual eye-camera 
records into the filmstrip projector, a& 
vance the film to the Start frame, and 
then advance it frame by frame as the 
data are collected, As each frame is pro- 
jected, she tilts and moves the projector 
from side to side whe 


Over its previous position, thereby auto- 
matically correcting 
head movement. After the record is run 
through, she rewinds it so that it is 


of the data record book, entering the 
data as they are called out by the other 
assistant. She also assists the other 
Worker in verifying the exact location of 
the eye dots on the screen, 

The second assistant is seated д 
other end of the room in front of the 
screen. When the start frame appears on 
the screen, the assistant at the screen, 
with the help of the assistant at the 
projector, locates the exact center of the 
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false eye registration dot and puts a pin 
in the screen at that point. Then she 
locates the center of the fixation dot in 
thejsfram» and puts a pin in that, The 
"Пе projector then advances the 
еу, Ха one frame. The first step in 
reading the second frame, as in all sub- 
sequent frames, is to determine if the 
false eye dot is still centered on the pm 
marking it. If it is not, the projectionist 
turns and tilts the projector until the 
false eye dot is superimposed on the 
pin again. The location of the fixation 
dot in the second frame is made after 
the false €ye dot has been realigned or 
immediately if this realignment is not 
necessary as happens in most cases. A pin 
is placed in the center of the fixation 
dot in the second frame. Then the dis- 
tance between the fixation-dot pin. es- 
tablished in Frame 1 and the fixation- 
dot pin established in Frame 2 is read 
aloud in millimeters, The assistant at the 
Projector records this as the first inter- 
fixation range measurement for that par- 
ticular scene for that subject. Then both 
assistants determine whether there are 
any other fixation points in that frame. 
If there are not, the pause duration is 
also entered as 4/24 of a second. | 

Occasionally more than one fixation 
dot appears in one frame, indicating that 
there was more than one fixation in the 
4/24 of a second that that frame re- 
mained motionless in the eye-camera 
Sate. It is easy to determine by the rela- 
tive density of the two, three, or e 
dots whether the pause duration shoulc 
be listed as 8/24, 2/24, or 1/24. 

The collection of all our data on is 
movement follows this procedure шр 
for a few variations. One variation OC 
curs when the fixation dot of the subject 
5065 so far off to one side that S 
off the screen, This probably i 
that when the record was made, the su 


"O CQ 


“ге 
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Ject was not even looking at the motion 
Picture, but glanced away from the pro- 
Jection screen. In this case, the operators 
go back to the previous frame “fafi: ye 
record and deliberately re-esta S the 
false eye dot a sufficient distance A. pne 
side or another so as to bring the eye 
dot back on the screen where it can be 
located, Then the measuring and the col- 
lecting of data proceed in the normal 
fashion. 

Another interruption of the normal 
procedure is the occurrence of blinks by 
the subject. The evidence of this is 
merely the absence of any fixation dot 
whatsoever. This condition lasts approxi- 
mately anywhere from 1 t0 5 frames. The 
false eye dot is, of course, present in 
every frame, indicating that the absence 
of the fixation dot was not due to fail- 
ure of the corneal light. Furthermore, 
the frame just before a blink always 
shows small light streaks radiating from 
the fixation dot. There are usually two 
light streaks extending in opposite direc- 
tions from the fixation dot and some- 
what resembling a blur caused in photo- 
Sraphing a moving object. These pecu- 
liar "blink warnings" make it possible to 
differentiate a blink from the situation 


where the subject might look so far away 
to one side from the motion picture 
that the fixation dot would not be pho- 
tographed at all. 

In general, it is found that the false 
eye dot remains in much the same posi- 
tion. When it does move, however, it is 
characteristic of it to move down gradu- 
ally from frame to frame and then sud- 
denly to jump back up into its original 
position. The rigid control of the head 
movement of the subjects while the cam- 
era records are being made prevents any 
erratic head movements. 

After all the eye records are measured, 
their accuracy is checked by a team of 
two other individuals who remeasure 
sample eye records chosen at random 
among all the subjects. One check 
showed that the original records were ex- 
tremely accurate and dependable. The 
averages of the eye-movement measures 
Letermined for each student for each 


scene differed by only one per cent be- 


tween the original analyses and the 


checking analyses. 
At the conclusion of the data collect- 


ing, all the eye-camera film is stored 
again in fireproof cans, taped up and re- 
turned to the film vaults. 


VII. SUMMARY 


Te Brandt camera (1) was modified 
to permit photographing суе move- 
ments in two dimensions by the corneal- 
reflection method while the subject is 
Viewing a motion picture. The Brandt 


camer ў а 
amera moves the film intermittently 
but at 


mes 
this 


а а motion-picture camera, 
relatively slow rate of two fra 
E second. In the modified camera, 
óna 1s increased to six frames per ae 
flm Synchronization of the eye-camera 
а with the motion picture being 

ed is achieved hy a cue!ng light. 


To permit analysis, the resulting film 
record is projected (by means of a film- 
strip projector) on a screen, where suc- 
cessive fixation points can be marked 
and interfixation movement can be 
measured linearly. Corrections for head 
movements are made at the same time 
by continually recentering the projected 
film image of a false eye worn by the 


subject. 
This method of photographing eye 


ibjects viewing educa- 


movements of st 
tional motion pictures is feasible and is 
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recommended for use in further inves- study is needed to assure that the films 
tigations in this field. The method makes have been planned and executed in a 
possible the study of individual scenes manner to achieve maximum teaching 


and sequences of teaching films. Such - minimum production costs. 3 
\ 
^| 
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СНАРТЕК I 


A, INTRODUCTION 
2 em PRIME purpose of this study is to 
carry out an exploratory study in 
the area of reasoning, particularly in re- 
gard to various tests in the repertoire of 
the clinician. In terms of science in gen- 
eral, the procedure of factor analysis is 
one in which certain of the relational 
characteristics of reality are given some 
order and reference. In some ways it 
offers some hope that eventually psy- 
chologists will be able to speak in terms 
that other psychologists understand, and 
it may even some day result in a broad 
common ground through which all sci- 
entists can interchange ideas. Perhaps 
the most philosophically sophisticated 
of the people who have shown interest in 
factér analysis, Burt, defines the proce- 
dure in general as a means of providing 
parsimonious descriptions of psychologi- 
cal data (6, p. 249): Although Thur- 
Stone maintains that his search for “pri- 
mary mental abilities” is not ап attempt 
to resurrect an elementarism in psy- 
chology, in many ways he speaks about 
his factors as if they were such elements. 
In general the yiewpoint is held by the 
present author that the mathematical 
analysis involved yields only data which 
have no inherent meaning and which 
must be interpreted by evidence from 
Observation by trained people. 
ж studies by Halstead (4 
кн Ge) present factors SUBEN, a n 
Mog паї abstruse, perhaps too ace 
nae pees difficult to understanc, and 
completely jdentified, are ones that 
ES may eventually have Mm mi 
рч usefulness than the highly ob- 
ге test-material type factors now 


) and 
while 
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generally recognized. Highly objective 
factors in the traditional Thurstonian 
analysis have found some usefulness in 
the area of vocational guidance but have 
been somewhat sterile in terms of under- 
standing either other individual be- 
havior or its abnormalities. Descriptive 
terms which are satisfactory in terms of 
scientific knowledge should not only 
meet a criterion of objectivity in a parsi- 
monious manner but should be able to 
contain or explain a broad range of 
human behavior if they are to be given 
the title of “primary mental abilities.” 

Prior to 1940 the results of factor 
studies have been subjected to a critical 
revigw by Wolfle (42). Since that time a 
well-organized summary of factor studies 
having relationships to aptitude and 
achievement has been undertaken by 
French (10). His analysis. summarizes 
most of the studies made with young 
adults and adults. He makes an attempt 
to bring together various factors identi- 
fied by different workers and renames 
them at times for cross identification. All 
in all, this book represents the contribu- 
tions that factor analysts have made to 
our knowledge of psychology in digested 
form. The reader is referred there for 


further study. 


В. PROBLEMS 


stions on which it was 
would throw some 
factorily 


One of the que 
hoped that this study 
light is: Can reasoning be satis 
subdivided into separate factors? 

Under this general question a number 
of possibilities might be true. Among 
these is the assumption that reasoning 
can be defined factorially in terms of the 
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steps in the reasoning process. These are 
generally given in terms of problem-solv- 
ing ability in which the successive steps 
are: first, recognition of the problem; 
second, bringing ideas to bear upon the 
solution of the problem; third, the 
weighing of various solutions to the 
problem; and finally, the testing of such 
solutions in practice. For many years 
logicians have separated reasoning into 
two components: deduction and induc- 
tion. It would be of interest to know 
whether or not these a priori systems of 
analysis are meaningful to the extent 
that they can be recognized in terms of 
the statistical procedures used in factor 
analysis. 

The design of the experiment makes 
it possible to make some empirical evalu- 
ations between typically objective test- 
centered factors as “verbal,” “spatial,” 
“numerical,” etc. against more ger ‘ral- 
ized factors as found by Meili. The test 
battery contains five of Thurstone’s tests 
which are supposedly relatively pure 
measures of factors found in his work. 
The tests also cont 
the battery 
ministered 


ain in the portion of 
which is individually ad. 
à number of tests which are 
similar to those used by Meili. Among 
these are the Comprehension test (No. 7 
in the battery), the Naming test (No. 11), 
the Block Design test (No. 7), the Pic- 
ture Titles test (No. 15). 

Another question was concerned with 
the factorial content of tests not pre- 
viously included in factor studies 
of which were tests which purported to 
measure reasoning, as, for example, the 
Arthur Stencil Design Test (No. 17), the 
Holsopple Concept Formation Test (No. 
10), the Hanfmann-Kasanin 
Formation Test (No. 20), and the 
formation tests devised by the 
Another general question to be ¢ 


» most 


Concept 
concept- 
author, 
xplored 


by the experiment was one concerning 
the relationship of concept-formation 
иге to the reasoning process in general. 
Gk ihan теп years ago Allport, ac 
d s to Wolfle, questioned factor 
atialysis because of its inability to meet а 
criterion of clinical usefulness or ү 
portance. Allport, in general, regarded 
factors at that time as statistical artifacts 
which have little or no relationship A 
real people. This complaint is still on 
which is felt to have some justification 
because of the rather limited usefulness 
of discovered factors. One aim pa s 
present study is to bring the clinical in 
statistical approaches into somewhé 
closer alignment. T " 
The largely rational, empirical yl 
proach used by clinicians perhaps де 
some overhauling in terms of ae 
strictness to prevent a meaningless d 
bosity; whereas, the highly objective en 
tisticians need the application of pa 
pirical evidence from the clinic to oe 
their manipulations have meaning. li- 
viewpoint of the author is that the TE 
nician needs to become a little m 
rigid in his use of language for the : n 
sessment of behavior, while the statist , 
cian needs to become more the psycholo 


к mati- 
gist and somewhat less the mathe 
cian. 
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N 
C. THE PRELIMINARY INVESTIGATIO 


упо 
А preliminary investigation peer 
à sample similar to the one to be art 
the main investigation was underta a 
in order to insure that the tests ier n 
suitable difficulty, that they [pita 
errors or ambiguities, and that sco! A 
methods and standards were suitable- o 
superficial examination of the a1 
this experiment was suggestive © in- 
Possibilities in the group of tests 
volved. 


M 


FACTOR ANALYSIS OF 


D. THE POPULATION 


The junior class of a high school ina 
town of approximately 7,000 pop? iG, 
formed the basis for the selection 
experimental population. The Я 
stone Primary Mental Abilities Test, 
Science Research Associates Edition, was 
administered to the entire junior class 
during one day of testing in the school. 
From the students present on the day of 
testing, a random selection was made 
and a list of 110 names compiled. From 
this group the 100 cases used in the ex- 
periment were selected in order. During 
the course of the experiment two stu- 
dents left school, one was not present on 
the final day of testing, 50 103 names 
Were used. Junior-class membership was 
divided into 46 per cent girls and 54 
per cent boys. In the 100 cases used 
there were 57 boys and 43 girls. 

This high school draws its population 
about equally from the town and town- 
Ships that are adjacent to it. In the ex- 
perimental group 43 pupils are trans 
ported by bus to the school. This is а 
of estimating the number 
Who are from rural areas) The mean 
age as given by the pupils on the test 
blanks, where they were requested to 
record their ages to the nearest half 
year, was 17.46 years. This may seem 
Slightly high for high-school juniors, 
Until it is recalled that testing was Con” 
ducted during the last two months of the 
school year. From the standpoint of 
achievement and maturity the group 
Occupied a position that was midway be- 
enior-class group- 


rough way 


tw = та 
een a junior- and s 


E. TEST ApMINISTRATION 


Following the scoring of the paper and 


1 
on Fs data are based on attendance records 
€ in the school, 
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pencil tests and the selection of the 
sample, the high-school guidance advis- 
ors were requested to select four stu- 
dents, two boys and two girls, among 
the first fifty on the list whom they re- 
garded as leaders in the class. These four 
persons selected were the first four to 
whom the individually administered 
tests were given. The purpose of this se- 
lection was to secure the cooperation of 
the remaining students to be later tested. 
Following the testing of these four per- 
sons, the remainder of the subjects was 
taken in convenient order. The place of 
testing was satisfactory, although upon 
occasion testing would be interrupted 
when movies, band practice, and other 
disturbing programs were held in the 
auditorium. All the testing, except for 
the final 20 subjects, was conducted by 
the author. With the final 20 subjects 
testé, the first 8 of the 16 individual 
tests were administered by a trained 
worker. With the first five subjects not 
tested by the author close supervision of 
testing procedures was made to insure 
standard administration. 

In general, the test battery appeared 
to be appealing to the students as evi- 
denced by the generally excellent rap- 
port. How much of this was motivated 
by materials used in the test and how 
as the result of students wanting 
to get out of regular classes was a ques- 
tion, but the over-all result was quite 
satisfactory- The average time of ad- 
ministration of the entire individual 
battery Was approximately two hours at 
the beginning of the experiment. As the 
test material became more familiar, the 
examiner's efficiency rose to а point 
in most cases, the testing was 
completed in an hour and forty minutes, 
or two regular periods of the school ses- 
sion. In general, this period of time was 


much w. 


where, 
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sufficient to allow a pace that was un- 
hurried but not wasteful of time. 


Е. THE INDIVIDUAL Test BATTERY 


In general, it was felt that the indi- 
vidual tests should meet certain criteria 
in order to qualify as suitable tests. Owing 
to the fact that the examiner had to con- 
duct the testing at rather irregular inter- 
vals, it was necessary to include only 
tests that were easily transportable. Ease 
of administration, objective scoring, 
and satisfactory scoring standards were 
other criteria used. Still another qualifi- 
cation of the test battery in general and 

of the individual tests themselves was 


z 
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that they should be administerable in a 
reasonably short length of time. In most 
azses, the latter was achieved to the point 
QS. sno individual test in the battery 
rA “ned more than ten minutes. Tests 
Wich did not meet this criteria in their 
original form were shortened or modi- 
fied. Another criterion was suitability in 
terms of difficulty. These criteria TM 
by and large, established in the prelim 
nary study with a comparable group. А 
In order to insure comparable mea 
ures for each student and to alae 
artifactual gains in performance yack 
gains in maturity, the testing Fn 
covered a period of only fifty-four day 


CHAPTER II 


DESCRIPTION OF TESTS 


HE FINAL test battery consist( 1 of 
FE tests, 5 of which were the sub- 
tests of the Science Research Associates 
version of the Primary Mental Abilities 
Test of Thurstone for group administra- 
tion (Intermediate — Form AH [38]). 
The remaining 16 tests were all of an 
individual nature. They consisted, in 
general, of word tests, perceptual tests, 
and tests using various concrete objects. 
A more thorough description of the en- 
tire battery follows: 

Test No. r. SRA PMA Verbal test. 
Test No. 2. SRA PMA Space test. 
Test No. 3. SRA PMA Reasoning test. 


Test No, 4. SRA PMA Number test, 
Test No. 5. SRA PMA Word Fluency test. 


These tests were included 
largely for purposes of factor d 
provide a means of com 
objective “Thurstonian” 
tors. 


in the battery, 
efinition and to 
paring some traditional 
factors with Meili's fac- 


An cxamination of the succeeding tests in the 
battery will reveal that all these tests except No. 
4 had counterparts in the individually ad. 
ministered group. Test 1 and Test 8 were both 
vocabulary test5, and Test 10 had vocabulary ele- 
ments. Test 2 had tasks felt to involve similar 
elements in No. 13, No. 17, No, 18, No, 19, and 


j sts resem 
No. 20. Test 3 had, of course, most tests felt to 
bling it in the reasoning arca. Test 5 Was 


a же зеш. resem” . 
be quite similar to No. 11, with some 


blances to No. 15. :milarities 

Test No. 6. The Wechsler Form II Simia 
test. (40). 

TN out was included in the test bes 
give a measure of verbal concept formatio would 
Other reason was that it was felt that it rcadily 
be valuable in establishing rapport, and у the 
accepted by the group. This proved to 
case. А Form п 
Test No. 7. Wechsler Comprehension 
0). 15€ 
е dus test was included in the battery de ues 
of its similarity with a series of prac eevee 
tions mentioned in the Mcili study and tó most 
it, too, was felt to be quite acceptable 
subjects and a good introductory test. anford- 

Test No. 8. A modification of the Bue ^ 
Binet Vocabulary Test (27). The items resented: 
14 to 38 inclusive of this test were P rodified 
The instructions for the test were ™ 
slightly and were as follows: 

"I have here a series of hard pet 2 
each word and tell me what it means. follow? 
‘skill’ mean?” Otherwise, administration 
usual Stanford-Binet standards. Я ive 

This test was included in the Bar 
added strength to any "verbal" facte 
compare the two different methods RE 
ministration, group and individual, 08 felt that 
the factors in vocabulary tests. It a dae test 
the individually administered voc? 


y {0 


terms 
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Would require a combination of fluency and word 
knowledge. 


Test No. 9. Judgment test. This test consiste 
Of a series of ten cards, 


ach with a адибо 
four suggested answers, which the subj 3 


required to rank in order of which ansW > E 
peared to be best. gs 

A preliminary selection of 20 items was made 
from Cardall’s Test of Practical Judgment (7) 
that was felt to be suitable for students of a 
high-school level. From this group of 20 items, 
the ten which had the greatest weights according 
to Cardall’s scoring standards were finally se- 
lected. These ten items were Nos. 10, 12, 15, 19, 
20, 26, 37, 41, 44, and 47. 

T € instructions for this test were, "I have a 
Series of cards that have questions on them. This 
test is to see whether or not you have good judg- 
Ment. Look at each card and tell me which an- 
Swer you think is best, which is second best, and 
Which is third best. Try this one.” After the 

first card the instruction was given, “You need 
Only to tell me the correct letters in the correct 
Order.” (This was said if the subject gave the 
Complete phrase rather than the letter.) 

Scoring used Cardall's weights for these items. 

, This test was used in the battery because of 
Ms unknown factor composition and because 
оше judgment measure that had face validity 


Was felt necessary for definition and evaluation 
Purpeses, 


pc Was felt, too, that it would provide a rather 


Gifferentiar; 
id €rentiating measure, and would serve to 


Cemonstrate the validity of the discrimination 
lement in the reasoning process. 

Test No. 10. Word Sorting test. This test was 
d by the author to provide a measure of 
^ Mem concept formation. The test consists of 
аы of 12 cards, on each of which there are 

Words, which can be divided into two 
ra according to a principle. In the first 
a ча the set which the subject has must 
Some pre! cliange from meaning of the words to 
in us herent characteristic such as the letters 
With oe ete. A preliminary study was made 
Possibilin, test in an attempt to eliminate the 
Sponse Чу of having more than one correct re- 
Words Ss method of sorting for cach set of 
means S " attempt was successful, for no other 
mental or, assification were given by the experi- 
ments, S'?Up which met the sorting require- 
AW В 
as foo directions for the word sorting test were 
га Sd here a series of cards with 8 words on 
king; à each card there are always two different 
Want’ ot Broups, or classes of words. What I 
there > to do is to tell me what two kinds 
(Prese 
i yon 
Sach k 


Bt 9n each card. Here is the first one. 
тед talion, card.) It will help you 
ing mber there are aiways four words of 

9n each card. It may be anything 
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about the words; what the words mean; the way 
the words are written, or anything at all" At 
card No. 8 the instruction was repeated, “Re- 
member it may be anything." The first card was 
explained if the subject failed to give the correct 
response or if he apparently had misunderstood 
the instructions. Similarly, when the first error 
was made, the criteria by which the words had 
to be sorted were reviewed for the subject. Most 
of these errors consisted of classifications with 
more or less than exactly four words in each 
group. Another question that was frequently 
necessary to ask was, "What is the other kind?" 
This occurred when the subject only classified 
one of the two groups on each card. The list of 
words was as follows: 
1. FAT, hat, mat, pat, RAT, BAT, cat, SAT 
(Demonstration) 
2. Betty, Paul, Ralph, Charles, Harriet, Helen, 
Harold, Florence 
з. hay, height, obey, bite, sleigh, weigh, kite, 
right 
4. beef, cow, hog, veal, deer, mutton, venison, 
sheep 
5. race, runt, sack, sick, rope, rule, sole, sunk 
6. John, Henry, Man, Woman, Person, Child, 
Genevieve, Susan 
o, what, goes, no, or, duck, to, fill 
inking, sweet, foul, slimy, pretty, nasty, 
melodious, pleasant 
9. wierd, slowly, silly, wiegh, funny, realy, 
Febuary, seldom 

10. doves, children, men, oxen, muskrat, cle- 

phant, snake, eel 

11. sad, lad, cad, fad, bad, mad, glad, dad 

12. egg, look, bed, up, odd, silly, light, rang 

13. editor, moon, lax, acting, betting, uncle, 

odd, many 

In the scoring of these items, one credit was 
given for cach group correctly categorized. Since 
cach card had two groups of words alike in a 
certain respect, a total of 24 credits was possible. 
The subject was permitted to try the card as 
long as he appeared to be productive. Generally 
after a minute or so he would say, "I can't see 
anything there." In such case, he was instructed 
to try the next one. Testing was concluded after 
four successive item failures, In some cases a 
subject was able to name four of the words which є 
belonged to one group and to give the principle 
by which they were grouped, but was unable 
to give the principle for the other four, In such 
cases, a credit of one was given. 

On the sample item the two groups of words 
are words written in capital letters and words 
written in small letters. In the second item, four 
of the names are women’s names and four are 
the names of теп. The similarity in sound pro- 
vides the basis for sorting of the third item, since 
there are four words which have an ite ending 
and four words which have an ay ending. T 
item four, four of the words are names of animals 
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and the other four are the names of kinds of 
meat. In item five, four of the words begin with 
r and four begin with s. Proper nouns and com- 
mon nouns or equivalent expressions thereof are 
the two groups used in item six. Four-letter 
words and two-letter words are the two groups 
in item seven. In item eight, four of the words 
have pleasant connotations while the other four 
are unpleasant. (This was mostly expressed by 
the subjects in terms of "nice" and "not nice.") 
In item nine, four of the words in the group are 
purposely misspelled; the other four are spelled 
correctly. In item. ten, four of the words are 
singular and four are plural. Adjectives, or de- 
Scribing words, and nouns, or names of things, 
are the two groups in item eleven, Four of the 
Words in item twelve contain double letters, 
while the other four have no letters repeated, In 
item thirteen, four of the words are begun with 
consonants and the other four with vowels. 

This test was included in the battery to give 
a sorting test using verbal material that would 
be analogous to the Buttons test, the Opposites 
test, and to the various block-sorting tests used. 
It was felt to combine elements of verbal factors 
and the hypothesized reasoning factor or factors. 

Test No. 1r. Naming test. This test Was an- 
other devised by the author in an attemnt to 
measure a crude sort of concept formation-with 
certain deductive elements, again using verbal 
material. It has been noted that early concept 
formation is apparently built around the abstrac- 
tions made in the use of language, the assigning 
of material to various classes, 

The instructions for the test were, “In this test, 
lam going to ask you to name all the things of 
а certain Kind that you can think of in one 
minute. For example, I might ask you to name 
white things, and you would say ‘snow,’ ‘clouds,’ 
‘linen,’ or ‘paper.’ Try this one. 1. Name as 
many red things as you can.” The test was then 
continued with 2. round things, 3. sharp things, 
4. cold things, 5. soft things, 6. elastic things, 7. 
things that there are generally five of in a 
group. During the testing, at the first pause in 
each group, the subjects were urged to continue 
by saying, "anything that is——will do." 

One credit was given for things that are alw. 
or usually associated with the named characteris- 
tic, One-half credit was given for things that are 
occasionally Or sometimes associated with the 
characteristic The tota] Score on this test was 
the total number of credits in all the categories 
mentioned, Examples of one-credit scores in 
the first category are fire-trucks, Stop-lights, and 
finger-nail polish; half-credit items were such 
things as cars, houses, dresses, etc, In the second 
group, all things that have the general char- 
acteristic of roundness were Biven full credit, 
including items in which the Shape was pri- 
marily spherical. The things given one credit 
were such things as rings, circles, etc, Half-credit 


ays 


i cts. 
answers here included such things as comp at 
tables, etc. In the third group, both ee, bem 
have sharp edges as axes, saws, etc. and 
MER. 


~ wele pointed as pencils and ice picks per 

fedt One-credit items are like ылы 
"ае above, whereas half credit was old А 
fof such things as pieces of metal, pes is 
things were credited in which the азо а 
made of usually being cold as ice cream, nigh 
ice, etc, and half credit was given p sm 
things as water, ground, or air. Soft bs as 
the full-credit group included such Ee "half- 
pillows, sofas, mattresses, etc.; and AS etc. 
credit group such things as food, es rubber 
Elastic things included such things аз and 
bands and balloons in the full-credit ШОР ag 
such things as socks and other articles of ee are 
in the half-credit group. In things that ee cents 
generally five of in a group, such things © tires 
in a nickel, or men in a basketball ШАША ей 
on a car (including the spare) were fu leaves 
items. Such items as petals on flowers, or ccific 
in a group were given half credit, it the T no 
flower or leaf having these characteristics Wa 
named. ro- 

This test was included in the battery = Pad 
vide a measure of fluency, wealth of ideas, 
deduction. 7 

Test No. 12. Opposites (sce Illustration ' 
test was devised by the author аз an attem in a 
get at certain aspects of concept тайнано aay 
task which involves looking at drawings Selected 
ous objects. The final group of drawings station 
included four test cards plus one demons uares 
card. The cards were called circles, e a from 
letters, and stamps. The task was to se ss s most 
a series of five choices an object which s rod on 
unlike another object that was first рес first 
the card. In order to accomplish um 5. phe 
step in the process was to attempt to d “iben 
way in which the objects varied, and reatest 
select the object which varied in the A card 
number of ways. On the аетопәан circle 
two variables were given. A small blac which 
was followed by three numbered circles е an 
Were successively small and white, yo for 
black, and large and white. Another monstra" 
additional practice was given on the dem cards 
tion card. On each of the four SHE a four 
which made up the actual test, there variables 
items which varied in terms of three f om five 
per card, and the selection was made variables 
numbered items. On the trees card, at d о 
were the shape of trees (either roun ving light 
angular shaped), tall or short, and ha iares, the 
or black trunks. On the second card, pile in th 
Variables were color (either red or на ап 
outer portion of the square), size of пате } 
shape of insert (either a diamond or 89 
à rotated or unrotated position). 

On the letters саз], the variable Гев 
or not the letter was ап a or a b, wheth 


ў, This 
npt to 


whe 
s were V or no 


“s2 L Soddo ^! worrvaursmri[ 
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it was printed or written, and whether or not it 
was capitalized or a small letter. 

On stamps, the variables consisted of length 
(long or short), the number on the stamp (5 
or 3), and whether or not the stamp depicted a 
scene or a person. А 

Instructions were as follows: “Here is а series 
of cards that have various things on them (the 
first card was presented). Notice the first circle 
here is followed by three numbered circles that 
are different from it. Point to the circle that is 
most unlike the first one." If the correct response 
was given, the subject was reassured by saying, 
"Yes, that is right." Or, if he gave an incorrect 
response, the examiner said, "No, it is this one, 
because this one is not only larger, but it is also 
black," or made the: necessary correction. and 
added, "It is unlike in both size and color." The 
other item was tried by the subject in the same 
manner. The next card was then presented by 
saying, “Try this one. During testing, when a 
subject would begin to tell the ways in which 
the selected response was different from the test 
subject, he was informed, “Tell me the numbers 
of the ones on the cards that are most unlike the 
first one." Following the conclusion of this phase 
of testing, the cards were returned to the subject 
and he was asked, “What are all the things that 
you had to look for on this card in order to find 
the right answer?" The first time one JJ. the 
variables was omitted, the examiner asked, “Was 
there anything else?” This question w. 
asked once, Occasiona 
question, “What are 
look for on this card 
answer," was made. 


One credit was given for each item correctly 
answered in the first group, plus one credit for 
each variable correctly named during the second 


part of this test. The total score was the sum of 
the two types of scores, 


This test was included in 
concept-formation test that ha 
characteristic of finding differences in addition to 
finding similarities, Its factor composition was 
unknown, but was felt to revolve around reason- 
ing and it was included as a perceptual task 
which would measure concept ability by means 
of recognition of difference, 

Test No. 13. Gottschaldt Figures, This lest was 
an adaptation for individual administration of 
the first 12 items on the SRA Research Edition 
of this test for group administration (31). These 


items were cut out of the Research Edition and 
pasted on 3 x 5 cards with the 


located to the left of the four s 


as only 
lly a repetition of the 
all the things you have to 
in order to find the right 


the battery as a 
d the anomalous 


age figures were used. 
cre presented on three dif. 
ferent cards which became successively more diffi- 


cult. The itenís were then numbered for con- 
venience in tabulating. Thurstone has described 


the characteristic that this measures as the ability 

to break perceptual gestalts (29). lows: 
The instructions for the test were as fo P. 
“I have here a series of cards on which sno 

“Ss дле hidden in some more complica 


= Look at this card (the first card in Me 
persion series is presented), As ye aoe 
а о the designs here in this row have a Tade 
in them (pointing to the squares). I recip os. 
pencil marks so that they stand out паа No. 3 
In this next group, designs No. 2 anc ü the 
have a V like this in them (again pointing ке it 
correct responses). This one has a V you ), and 
is not the same shape (pointing 15 Ван it is 
this one (pointing to No. 4) has a V too, b js not 
not turned in the same direction, so that i 
correct, either." (Card No. 2 is presented) Del 
card is for practice. Which numbered, c the 
contain the big plus sign like this? (8 ad give 
subject's response, correct any crrors na card." 
explanations.) “Try the next one on onstration 
(Again correcting errors.) The last demon er said, 
card was then presented and the examin S 
"Here is a harder one like the ones pes part 
have to do in the regular test. Try this sg this 
of this test is to see how quickly you can work 
kind of a problem, so you will have Mar о 
rapidly. Don't spend too much time оп ‘rather 
them. If you can’t see it in number e have 
quickly, go оп to number 2, ctc. You bor gen- 
thirty seconds for each card, and this М1 over 
erally be time for you to look each mol the 
fairly carefully. You need only to tell ai to 
numbers for each card, It may also help 7 огі 
know that it may be in none of the деу hum 
may be in all of them. There is no НИТ 
ber on each card.” (Present last demons б 
card.) The subject then gave his respon сої“ 
last demonstration card, any errors we object 
rected, any omissions pointed out and the k 
Was cautioned, "Sometimes you have ai t 
pretty carefully.” The first test card A OD i 
presented and at the conclusion of thirty H Ja 
the examiner suggested that the апор owevels 
to the next card. On succeeding cards, = ап 
he was not prompted to try the next ; cases o 
generally chose his own pace, except ded one 
extreme delay, where the time excee 


minute, ding 
А eat accor 
The number of items correctly given rs man 


10 the standards set forth in the examine 
ual for this test was used. ime WETE 

No time scores and no limitations euer. 
made except for the instructions. еа edit test 
tions were designed not to provide a ч ne over 
but to prevent a subject dallying too jent time 
each card. It was felt that, given ee 
all subjects could answer correctly, a 

This test was included in the test 
cause it was felt that it might have 5d bility re- 
tion with reasoning in the analytica sive SO £ 
quired to perform satisfactorily and 8 


wi, 


hen 


| 


= 


^ 


the Sto 
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idea of the subject's ability to break a particular 
Set. 

Test No. rj. The McGill Picture Anomaly 
Series (17), Form N, the abridged version. This 
test was a series of picture anomalies oP cts SEN: 


ы consisting of 21 items in the abridg; 
N. i 


Instructions for the test were simply, "phat 
to what is funny or out of place in these pic- 
tures.” Additional instructions, "Use this brush 
so you don't make any marks on the paper,” and 
We'll only do the ones marked with a star or 
aster sk beside the number,” were included. 

. This test was included in the battery because 
it was felt that it might play some role in de- 
lingating the role of rejection of hypotheses in 
ae reasoning process, in which a large number 
‘od hypotheses are brought to bear upon the prob- 

m and the absurd ones are discarded. The 
recognition of error in general was felt to be of 
some importance in reasoning and its role needed 
definition, 
| Test No. тз. Picture Titles. This test suggested 
Py one of the items in Meili's battery (22) con- 
Sisted of a series of five pictures to which the 
Subject was requested to give titles. There was 
Чо One demonstration picture. The pictures 
Vere from Wells and Ruesch's Mental Examin- 
ls Handbook (41). They are Bus Passengers, by 
аас Soyer; Morning on the Cape, by Leon 
Kroll; After the Tornado, Bahamas, by Winslow 
нана; The Pioneer, by Winslow Homer; Rum 
ау, by Winslow Homer; and The Nesters, by 
om Lee. The Bus Passengers picture, by Soyer, 
Was used as a demonstration card. 

he instructions for the test were as follows: 

I have here a series of pictures to which I want 
You to give titles. Give three titles for each one. 
Seon the first card.) For example, you might 
E. this card, ‘People,’ ‘At the End of the Day, 
ae ape ‘Bus Riders. Try this one." If he 
the w to give three responses, he was urged by 

words, “Give three names for each picture.” 
я credits were given for a title which sub- 
nds the basic characteristics of the picture. 
Hees credit was given for titles which con- 
the qe mere description or enumeration. On 
Were E card, satisfactory two-credit responses 
“Be нс things as “Morning on the Farm, 
те ү of the Farmer's Day,” etc.; one-credit 
Gir» «p Were given for such things as "School 
9 loughing,” etc. Оп the next card, “After 
rm" and “Shipwrecked” were two-credit 
Were ud While "Desert Island" and "Dead Man" 
next сше of one-credit answers. Оп the 
Were give Clearing the Forest" and "Pioneer 
З осон two credits, while such titles as 
Credit, Gee and “Lone Tree” were given one 
Were "n the next card, two-credit responses 
"Race fo h things as “Catching the Turtle" or 
things 5 T the Sca." One-credit answers were such 
5 "The Turtle" or “The Black Man." On 


answer 


the last card titles as “Western Farm Scene,” 
“Pioneer Farm,” and “Farm Out West” were two- 
credit answers, while “Farm Girl” and “Plough- 
ing” were one-credit answers. 

This test was included to give a measure of 
perceptual fluency or richness of ideas, or ability 
to synthesize the elements of the situation by 
abstracting the essential meaning. It was also 
felt, because of the request to give three titles, to 
give a measure of some of the power elements 
of intelligence. 

Test No. 16. Rorschach (Beck's Z score) (4, рр. 
58-82). In this test three of the series of Ror- 
schach's ink blots, cards number II, III, and IX 
were presented. 

The instructions for this test were "I have 
here a series of three ink blots. What I want you 
to do is to tell me what they look like to you, 
what they might be, and what they remind you 
of. Tell me three things for each card." The 
cards were then presented with the additional 
instruction that "You may use any part of the 
card, or turn the card any way you like to give 
your answers." 

Subjects were urged to produce three re- 
sponses by saying, "Look at it a little longer, 
perhaps you may sce something else," when they 
stopped short of the requested three responses. 
Folloring the presentation of the three cards, 
an Шыу for position and further definition of 
the organizational elements required by the Z 
score was made, Other Rorschach inquiry was 
omitted. 

Scoring was according to the standards estab- 
lished by Beck. The three card scores were then 
combined to get a total Z score. 

This test was included in the battery as a 
somewhat less concrete test of the abilities re- 
quired in the preceding test. Too, it was felt that 
the ability to make combinations was of some 
importance in the reasoning process, and accord- 
ing to Beck has definite intellectual aspects. If 
this were so, it was felt that they would revolve 
around some sort of reasoning ability. It was 
felt that it might give some test of Meili’s belief 
that factors could be applied to all of behavior 
and not just cognitive functions. 

Test No. 17. Arthur Stencil Design Test (2). In 
this particular test not all of the cards were pre- 
sented because of the time limitation. (The total 
testing time for a complete test is usually about 
3o minutes.) The final series of cards selected 
consisted of numbers 1, 4, 5, 8, 18, 17, and the 
demonstration card. 

Another change was from a time limit of four 
minutes, which Arthur uses, to one of two 
minutes in order to give a test of suitable diffi- 
culty for high-school students. The instructions 
for this test were as Arthur suggests. 

Three credits were given for each design com- 
pleted within 2 minutes. Additional time credits 
were given as follows: 
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1. 59-1 
4. 20°—1 10°—2 
5. 20%—1 
8. 40*—1i 
13. 40°—1 
17. 50%—1 


These were then summed for a total score, 

Only the necessary stencils to complete the re- 
quired designs were presented. А 

This test was included in the battery to give 
some idea of its factor composition since it pur- 
ports to measure, according to the author, “logi- 
cal reasoning.” Another reason was that it ap- 
pears to be a task rather similar to the Block 
Design test No. 18 and its factor composition 
could be compared with that of a test that has 
been previously subjected to factor analysis. An- 
other reason for its inclusion in the battery was 
the fact that it was felt to be a good transitional 
test from the perceptual tests previously used and 
the tests involving concrete objects used subse- 
quently. 

Test No. 18. The Block Design test. This test 
is the Wechsler Form II Block Design Test (40). 

The inclusion of this test in the battery was 
suggested by the variety of factor composition 
found by different investigators using a variety 
of this test. 

Test No. 19, Holsopple Concept Forn }tion 
Test (21). This test consists of 16 different blocks 
which vary in eight Ways, each block containing 
four of the variables. The variables used are 
color (blue or red), shade (light or dark) or in- 
tensity, shape (square or octagonal), width, 
height, size of insert, color of insert (white or 


here as No, 19, it was 
No. 20, which served the Purpose of acting as 
partial instruction for this test. 

The procedures followed in the instructions 
were as follows: 

^I have here some different kinds of blocks. 
"These blocks like the others can be sorted into 


ever, with these blocks there are always exactly 


four in each Broup, and they can be Sorted in a 
number of different w 
is to sort them into 
occurs to you.” (Tf n 


sort, the subject was asked to verbalize the b 
of the sort. If he only mentioned one 
or had some difficulty in verbalizing any variable, 
further questioning was conducted by asking, 
“What is the way in which all the blocks in this 
Broup are alike?” If the subject still failed to 


recognize the sorting principle, he was m 
"How does this group of blocks differ from ж 
group?” Following this period, the subject та 
requested to "Now sort them in a шшш иву 
Ic. tbesvay you sorted them the first Le Nen 
qf A. s conducted as with the first sort. ES 
th Apject was prompted to sort them pu is 
inf, "As you see, these blocks can be sorte be 
many different ways. I am thinking of a 2 
that is different from those you've already ar 
Go ahead, and start sorting the blocks to see 1 
you can figure out the way that I have in po 
You might make some mistakes at first, but a а. 
awhile you will see the way I have in mind a 
be able to do them without error.” The last 7 
was made according to an a priori judgmen: cu 
the author concerning the difficulty of edi 
sorting Principles, These were in order үне jn 
ing the principles of height and width use 
the test previously administered, No. 20): 


1. height 5. shade 

2. width 6. shape of insert 
3. color 7. color of insert 
4- Shape of block 8. size of insert 


| were the 
While Nos. 1 and 2 are ordinarily among 


5 t 
more difficult of the Sorting concepts, it was E 
that since they were the principles in the PE 
vious test, they would be among the casicst d 
ing principles on this test, If the subject er 
these principles, he was given full crcdit. О не 
Principles were used with less frequency, DY 
the first two sorts it Was possible to unie nd 
three of the principles. In some cases, p pen: 
four were used and in such case, as in the vd s 
where the three were used, the next two ps 
of difficulty were presented in the final ae ie 
In cases where the sorts used were ашкы not 
more difficult ones, the easier ones which eh 
been utilized were employed for the one first 
except that only one variable out of on 
two, height and width, was ever employed. 


first 
Four credits were given for each of hae 
two sorts correctly done without error. hich 


credits were given for sorting combinations оп 
employed two principles in two of the = two 
Spaces and other principles in the — ed, 
spaces. In such cases, the subject was Xen orte 
"Look them all over to see if you have АДЕ 
the same way in each group.” If he р е f 
Ously rearranged the blocks correctly, à т 
three was given. On the third sort, a ES E 
four was given if the subject теори point 
principle of sorting one block beyond th Three 
where sorting had become detects Two 
credits were given two blocks M prin- 
credits were given beyond this point. pee of 
ciple was discovered (based upon the cri а 
Crrorless placement in the remainder credit 
blocks) before the last four blocks, one 
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Was given. Sortings are pessible in which the 
principle docs not become determinate before 
the ninth block, and in such cases the one score 
Was reserved for the last three blocks. 
Scoring for the inquiry portion of the te: 
as follows: Four credits were given for 
Verbalization of both sorting principles: 
Was necessary to ask the way in which alf the 
blocks in the group were alike or to inquire as 
to the difference between groups, only one credit 
Was given for cach variable provided the subject 
Was able to verbalize it adequately. No credit 
Was given in cases where verbalizations were in- 
adequate, The total score on the test was the 


sum of the sorting score and the verbalization 
score, 


This test was included in the battery because 
of its unknown factor composition, and the fact 
that it purports to measure concept-formation 
ability, It is different from the next test (No. 20) 
in that it covers a much wider range of material 
and has a characteristic of flexibility lacking in 
the other, The testing procedure was very flexible 
and permitted a spontaneity not found elsewhere 
in the battery, 

. Test No. zo. Hanfmann-Kasanin Concept 
Formation Test (16). This test was modified by 
the author to save time and to provide a more 
objective scoring method. To make it a more 
practicable test, it was decided that the following 
directions and instructions would be given. 

, have here a group of blocks, There are four 
different kinds of blocks in the group. This one 
Picking up the yellow semi-circular block) is 
called a Вік, It goes here” (placing the block on 
the appropriate corner of a card divided into four 
Spaces which was used as a sorting area). “It goes 
Rere where it says 'Bik.'" “This kind of block 
(Picking up the large blue square block) is called 
а ‘Lag.’ It goes here" (placing the block in the 
«Ag space). (Picking up the small white hexagon), 

is kind is called ‘Cev.’ It goes here" (placing 

the block in the Cev space). “This kind of block 
(Picking up the high narrow orange colored tri- 
angular shaped block) is called ‘Mur’; it goes 
cre” (placing it in the appropriate space). The 
examiner then continued, “Now I've shown you 
ene of each of the four different kinds of blocks 
rh Broup. What I want you to do is to go 
thi ad and put the rest of the blocks where you 
ink they belong. Pick them up one at a time, 

€ careful not to look at the bottom, and put 
vee Where you think they might go or belong. 
you ae you may make some mistakes because 
you eh know the way the blocks are sorted. If 
block боз a mistake, I will tell you where the 
able s. ould go, and after a while you will be 
able to See the way the blocks are sorted and be 
© ah, do the rest without making a mistake. 
cad now and try one where you think it 


might belong.” Corrections were made as neces- 
sary, and the blocks were turned over to reassure 
the subject that the examiner was not making 
up a sorting scheme of his own at each mistake. 
This procedure was continued until all the 
blocks were sorted. The subject was then asked, 
“How do they go?” And if he hesitated, “What 
is the principle by which the blocks are sorted?” 
If he still was unable to see the sorting principle, 
he was finally asked how all the blocks in each 
particular group were alike. And if he still failed 
to perform satisfactorily, he was requested to 
point out the difference between groups by the 
instructions, “In what way are the Murs different 
from the Cevs?" If he still failed, the solution was 
explained to him. The latter phase of the testing 
was conducted largely as an introduction to the 
next test, No. 19. 

The scoring scheme used in the test was a com- 
bination error-time score. The number of errors 
made was subtracted from 20 and the number of 
minutes to the nearest quarter was subtracted 
from five and multiplied by four. These two 
scores were then added for a total score. 

This test was included in the battery because 
of its unknown factor composition, its fairly wide 
use in the clinical field as a test of concept for- 
mation, and the rather rigid requirements of its 
unique solution for its performance. In contrast 
silices: No. 19, time elements were utilized in 
its scoring and the freedom of choice in the above 
test was not only unavailable here for the sub- 
ject but was probably handicapping. 

Test No. 21. Buttons (See Illustration 2). 
This test was devised by the author specifically 
to give a test that was similar to 10 and 15, using 
concrete objects rather than words or perceptual 
material as the test items. The test consisted of a 
series of ten cards (post card size) upon each of 
which there were a number of buttons which 
were all alike, except for one, in a certain way. 
An additional card used for demonstration con- 
tained six buttons which were identical except 
one. On the remaining cards the buttons were all 
different and the subject was required by the 
nature of the test to recognize the way in which 
all the buttons were alike and/or select the one 
that was different in a respect in which all the 
others were alike. On card No. 1 all buttons had 
the same diameter except onc. On card No. » the 
buttons all had two holes in the center except 
one. On this button the holes were near the edge. 
On card No. 3 all buttons had two holes except 
one which had four holes. On card No. 4 all but- 
tons were opaque or “colored” while the different 
button was transparent or colorless, On card No. 
5 the buttons were all upside down and all pos- 
sessed the common characteristic of having a 
projection for insertion of the thread that lay 
parallel to the face of the button except one 
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Which had the holes rumiing perpendicularly 
to the face. On this card an alternate answer was 
also possible. On one of the buttons the material 
consisted of pearl and metal, making possible an 
alternate correct response of being müde of two 
different kinds of material, whereas the others 
Were all of one material. On card No. 6 all but- 
lons were monochromatic except one which was 
two-colored. On card No. 7 all the buttons were 
Yound except one which was somewhat square 
Shaped. On card No. 8 all buttons except one had 
grooves or indentations for the thread, probably 
to prevent the thread wearing out through fric- 
tion. One button lacked this groove. On card No. 
9 all buttons except one had some sort of rim ex- 
tending around the outer periphery. On card No. 
10 all buttons except onc had a shiny appear- 
ance due to the fact that they are either simu- 
lated or real mother of pearl, whereas, the dif- 
ferent button was somewhat dull, and made of 
à different material, perhaps palm nut. 
The instructions for this test were as follows: 
I have here some cards with various kinds of 
buttons on them. What I want you to do is to 
look at these buttons and tell me which button 
does not belong in the group. Look at this card 
(presenting demonstration card). All of these 
buttons except one are alike in a certain. way." 
Point to the one which is different. After this 
Was done say, “Yes, that is right, remember that 
all the buttons are alike except one, in a certain 
Way.’ I want you to tell me which one is dif- 
ferent.” (Present first card.) “Which one is dif- 
ferent here?” After the button was chosen by the 
Subject, he was asked, “And how are all the other 
buttons alike?” The first time an incorrect re- 
Sponse was made on a card, the error was shown 
to the subject by pointing out how the remainder 
Of the buttons were not alike in respect to the 
Way he had made his selection. He was then al- 
lowed to continue with the same card until he 
Achieved the correct solution or was unable to see 
А solution, whichever the case might be. This 
Procedure was followed for each additional card. 
mee only one such correction was made 
T cach card. 
"es point was given for the correct selection 
f the “different” button and one credit was 
on for an adequate verbalization of the way 
eh hich all the other buttons were alike. In some 
select where the subject was certain that he had 
give ed the right button, but was unable to 
Dd adequate explanation of the similarity 
ota E the others, he was given one credit. The 
indivi S was a summation of the scores of the 
idual cards. 
масе, test was included in the battery to pro- 
nena eee test to Tests No. 10 and 12 as 
test of ed above. In-general, it was felt to be a 
concept ability using fairly common ob- 


jects. On the basis of the preliminary testing, the 
test was found to be one which evoked consider- 
able interest and left a feeling of general good 
will toward the test battery as a whole. It was a 
relatively easy test compared to some others in 
this battery and of genuine interest to practically 
all subjects. 


A. STATISTICAL TREATMENT OF THE 
RESULTS 


An investigation centering around the 
area of reasoning was undertaken. A 
preliminary selection of tests purport- 
edly measuring this area was made. 
These tests were modified if necessary, 
for feasibility of administration to a 
high-school population. On the basis of 
this investigation tests were modified for 
the study. One hundred subjects were 
selected in the junior class of a medium- 
sized high school following administra- 
tion of the Primary Mental Abilities 
test (SRA) to the entire class. The re- 
majming' sixteen tests were administered 
m one-hundred subjects selected as 
an experimental group. Testing covered 
a period of approximately two months. 

Pearsonian coefficients of correlation 
were calculated (see Table 1). Factoring 
was done using the group centroid 
method of Thurstone (32, pp. 149 ff). 
The method outlined on these pages, in- 


_cluding checks, etc. was followed closely. 


After the seventh factor was extracted, 
the residuals appeared to be too low to 
merit another extraction. In order to 
provide rotational freedom and insure 
the extraction of all possible meaningful 
factors an additional factor was ex- 
tracted. This factor could be discarded 
later if necessary without causing too 
much computational adjustment and 
was felt to allow convergence of solution 
somewhat earlier than otherwise would 
have been the case. In general, in the 
author's opinion, in an exploratory 
study as this the extraction of all pos- 
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TABLE 2 
Сехтко FACTOR Loapincs (TABLE A) 


I II IH IV у VI | WI | WII | hs? 
= o 

I | 6457 —43 —12 153 027 138 | 179 | —112 2055 
2 | d ee eo 184 261 143 032 ооо 5052 
3 629 —307 | 245 148 146 —173 —028 | —152 6470 
+ | 274 —421 217 | 240 | —144 077 | — 076 | тот 3996 
5 448 — 306 200 | 307 —164 | 128 —144 —111 | 5049 
6 544 | —262 | —o85 | —087 | —205 212 —104 170 | 5329 
7 413 32 | —198 156 165 130 —170 126 3768 
8 755 —173 | —306 | —196 | —озо 026 o89 | —137 7603 
9 430 180 009 | —244 253 | —186 062 | —os8 3025 
КӘ 633 -—-ua | ату | ux 307 034 | 097 | оўо 5872 
II 381 103 —200 | o8s 142 092 215 | 276 3540 
12 551 —040 040 —132 133 —180 — 093 —118 | 3060 
I3 461 262 обт | 186 005 269 279 | 108 4004 
I4 350 139 | —328 —ogr —167 076 138 | —x79 | 3424 
1$ 435 285 —354 | 097 —120 —144 —126 122 4711 
16 194 160 —227 | 326 220 —229 164 106 3600 
17 634 245 | 233 —146 —270 085 251 | —102 ботт 
18 599 203 352 131 —096 —046 160 110 5901 
19 дот 160 155 —175 139 127 —4257 219 3905 
20 436 одг 287 —082 189 126 — 202 ==174 4101 
21 489 —031 —o84 —241 —ogr —130 133 173 3780 


* H "n + 
Decimal points are omitted. 


sible factors is justifiable. The unrotated 
factor matrix is shown in Table 2. 

The method of extended vectors of 
Thurstone (82, pp. 225 Е.) was used for 
rotation because this method offers a 
rapidly convergent solution. Thurstone 
maintains that this particular method is 
Suitable for batteries which show a posi- 
tive manifold or positive correlations. It 
is not suitable for bipolar factors. Either 
ап oblique or orthogonal solution is pos- 
Sible, Simple structure expressed in 
terms of minimizing as many loadings 
ОГ tests on factors as possible was one 
Soal of rotation. In general, the most 


important criterion used in the prelimi- 
nar rotations was psychological mean- 
ing; For this purpose, the tests in the 
battery which had been found to have 
high loadings in certain factors were not 
allowed to influence rotations unduly, 
although it was felt that certain of the 
tests used in the battery for purposes of 
identification would have high weights 
in this analysis. In general, the tests 
showed good structure on the plots from 
about the third rotation and the re- 
mainder of the rotations was made to 
reduce angles, and obtain simple struc- 
ture. One of the rotated factors was not 


TABLE 3 
CosINES OF ANGLES BETWEEN PLANES 


| J Fx 

A 1.000 | | | | 
5 —.о12 999 | 
J 2058 042 1.000 | 
Pr +105 115 —.029 1.000 | 
c .ооо 003 —.130 — .009 1.000 | 
Rp .030 014 —.110 —.о14 —.026 1.000 | 
Fx —.orq | —.о3ї 2025 | —.029 .042 +063 1.000 | 

* —.032 | .036 |  .o33 022 | 002 ‚ооб 5-5 | 
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TABLE 4 
CUMULATIVE TRANSFORMATION Matrix 

П EU E m m Pe 

| Be] 5 [ т [ 4| He Rp B Fx 
| | * 65 
I 397* | 240 | 450 | au 345 336 240 a 
II — 792 347 | —1зї o63 | O12 27 147 | ee 
ш 130 *| 799 | —oss or2 | —о22 — 368 440 | Cao 
IV 229 004 —464 843 —143 057 —129 | 876 
у —024 —o53 | зи | OII 203 159 —024 Loa 
VI 174 465 | —304 —147 | 340 | 205 —672 228 
VII —321 123 377 | 295 180 —690 —402 aaa 
VIII — 108 — 290 —466 | —o4; | 819 | —152 311 iios 


* Decimal points are omitted. 


satisfactorily meaningful in terms of the 
criteria heretofore mentioned and con- 
sequently on final rotations it was neces- 
sary more or less to ignore this plane in 
order to achieve satisfactory solutions 
with the other factors. In general, simple 
Structure was not complete in the bat- 
tery as can be seen from an examination 
of Table 5. However, with some of the 


factors it is reasonably achieved. Thur 
stone points out that in experimental 
factor studies complete simple RE 
is rarely attained (ge, р. 256). In genera» 
the solution of the problem is orthogo 
nal as can be seen from the angles 11 
Tables 5. The transformation matrix İS 


shown in Table 4. 


Îi TABLE ; 


INTERPRETATION Matrix (A) 


eee 
Test A 5 E 
J Pr G Rp B NES. 
т 597* 034 383 407 IQI 012 — 183 s 
2 148 166 247 102 203 102 376 5 
3 550 171 412 397 028 029 271 E 
4 556 979 | —o77 253 116 | —124 o82 Tus 
2 6or 227 006 371 —004 о8о 052 124 
478 ors 054 037 334 216 059 320 
7 oso 034 —o18 243 278 471 042 6 
i 8 344 —032 5бо 164 200 241 —049 308 
9 —067 159 464 037 135 139 abi | CAD 
то 290 000° 497 I2I 394 150 Ost E 
ІІ 149 оол 162 196 —200 399 073 218 
I2 233 078 434 122 обо 212 279 E 
I3 —031 369 085 405 384 116 —110 999 
14 —042 012 260 IIO оїз 213 —186 391 
15 —072 —159 032 254 ISI 423 166 2 
= Ec - v 076 443 IIo 094 044 "o 
оо 51 342 223 I 126 
18 084 436 158 15 ER 246 
425 266 ог І 
19 одо 218 039 —072 366 uus 308 366 
4 221 414 235 054 059 297 193 E 6 
І 071 —043 326 047 308 ооо 197 98 = 


* Decimal points are omitted. 
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CHAPTER III 


SUMMARY OF THE FINDINGS 


A. FACTOR A 9 


I. Is FELT that this factor can be best 
described as a learned activity factor 
that includes all those things that we 
Ordinarily call “academic” in nature. Its 
Primary expression in the test is through 
verbal material, but this fact is not sur- 
prising when we consider that most of 
Cur learning takes place through use of 
and by means of verbal processes. It in- 
volves the use of symbols and abstrac- 
tions. In some respects it may represent 
the part of one’s learning which is some- 


What artificial or scholarly for use in 
school, 


On factor A tests with substantial loadings are 
5 б, 8, 10, 12, and зо (see Table 5). This 
factor Was most strongly identified in the Pri- 
Mary Mental Abilities portion of the battery. It 
Was moderately strong in the adaptation of the 
Binet Vocabulary No. 8 and in the author's Word 
Orting test No. 10, The highest weight is in the 
Vord Fluency test of Thurstone and only slightly 
Css Strong in his Verbal test. (Vocabulary). This 
at first suggests a “Verbal” factor until one at- 
tempts to explain the weight of the number and 
he reasoning test scores in "Thurstone's tests. It 
Would also seem to be a factor which is found al- 
ue exclusively in the type of activity required 
А, а speeded paper and pencil test of the type 
Sed in this analysis, except for the fortunate 
Circumstance that several of the individual tests 
Have fairly substantial weights (No. 6, .478; No. 


ast No. 10, .290; No. 12, .333; and No. 20, 


This f 
task” Ға 
Perce; 
integ 


actor is quite similar to the “restrictive 
ctor identified in Thurstone's analysis of 
ption (29) and is similar to the "central 
ee factor of Halstead (14) which he 
indivi Бү аз the “well-organized habits of the 
ag, "al^ Halstead’s belief that this factor 
intent high loading on so-called “psychometric 
self pose is thus justified if one confines one- 
conside paper and pencil tests and docs not 
tests ‘ct “psychometric” to include the individual 
Halstead the _терегїоїге of the clinician. Since 
Tange of derives his description from a wider 
attery mo arial than was included in our test 
Somewh € might have some justification for his 
the Pri at broader factor name. In our battery 

Nciple of parsimony and the lack of such 
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range must limit our description to a so-called 
“academic” factor or learning factor, Certain 
of the tests which are quite similar in nature 
yield some support for the identification of this 
factor. For example, test No. 5, Word Fluency, 
in which the subject is required to name as many 
things as he can think of within a certain period 
of time that begin with the letter s, when com- 
pared with test No. 11, the author’s naming test 
in which he is required to name red things, 
round things, etc. shows a rather substantial 
difference. In the case of the latter, the loading 
is only .149. According to some authorities both 
these tests should have loadings in and would 
primarily measure some sort of fluency factor. 
In terms of learning it is felt that initial letters 
are of considerably more fundamental nature 
than the enumeration of objects according to 
certain standards as required in test No. 11. The 
construction of dictionaries by alphabetical ar- 
rangement rather than by conceptual classifica- 
tions is one illustration of this difference. Tests 
No. 19 and 20 show a somewhat less startling 
difference, but one which yields some slight cor- 
robor-jing evidence. The first test is a block- 
sorting test in which a number of variables are 
taken into consideration, while No зо is a 
similar test with a single solution dependent 
upon the characteristics of height and width of 
the blocks. The way in which this test difference 
adds to the evidence is that one of the most 
usual methods by which objects are compared 
is by a criterion of size. The word "big" or the 
word "little" is felt to become a part of the 
young child's learned-response repertoire before 
such things as the other variables measured in 
test No. 19. In general, the tests which employ 
that which is new or unfamiliar or unusual have 
zero loadings on factor A. This is believed to be 
the reason why test No. 2 (the Space test) in 
the PMA series has relatively low loading, par- 
ticularly when compared with the other subtests 
of this group test. Tests No. 7 and No. 9, both 
of which employ verbal material, are more diffi- 
cult to explain, but it can be postulated that 
the requirements of these two tests are somewhat 
more discriminatory than is ordinarily needed in 
the course of one's educational history. Tests 18, 
14, 15, and 16 all have slight negative weightings 
in this factor. In each case it can be argued that 
the material has little representation in terms 
of the psychological functions involved in learned 
activity. (It is of some interest to note that the Z 
score on the Rorschach has a weighting of 
—-114. The remainder of the tests, except for 
No. 20, were all relatively new tasks for the 
majority of subjects. 
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While this sort of a factor called “academic” 
in our analysis has been identified in other 
works as noted above, it is felt that the descrip- 
tion herein given is well defined and identified 
by the tests in the battery. Subjecting this fac- 
tor to our criteria for adequate factors suggests 
that this factor meets the standards satisfactorily. 
It should be of some interest to both clinicians 
and general psychologists as well as others in- 
terested in psychological functioning of human 
beings to be able to attain measures of the effects 
of one's learning experience, It might, if 
validated by further studies, be conceivable that 
if such a factor can be accurately identified, 
we could use it as one approach to study some 
of the shortcomings of our educational theory, 
and more particularly, our educational practice. 

It is the opinion of the author that psycho- 
metrics must be broadened to measure other than 
the characteristics measured in the average group 
intelligence test. This may be difficult, but cer- 
tainly the whole area of limitations of tests of 
particular types needs more airing. One has 
only to see people classified in terms of tradi- 
tional tests as “borderline-feebleminded” func- 
tioning adequately in everyday social contacts 
to realize that tests sometimes do not tell the 
whole story. In our high-school population one 
of the surprises of the entire battery was to find 
that five persons had “quotients” of less uin 7o, 
the usual dividing line between feeblemindedness 
and normality, Many teachers would undoubt- 
edly agree that they had “morons” in their 
classes, but they were probably employing the 
term somewhat less carefully than a Psychologist 
should. One of the striking characteristics of 
some of these "borderline-feebleminded" subjects 


tests in the individual 


expect and in some cases 
the average of the rest 
not felt that the auth 


were considerably above 
of their classmates. It is 
or was fortunate to en- 
counter a large group of idiot-savants among 
the hundred subjects used. It was felt that, in- 
stead, he was dealing primarily with academically 
handicapped people—in most cases probably poor 
readers. On the basis of social intelligence and 
other nonacademic activity, the "moron" 


group 
appeared to be relatively normal. 
B. FACTOR S 
This factor is likely most closely 
identical to some "spatial" factor in 


which the size, shape, or appearance of 
objects plays a predominant role. It is 
felt that this factor must be regarded as 
lacking entirely adequate psychological 


M. 


CORTER 


interpretation in terms of the particular 
tests employed. 


Tests No. 18, 17, and 20 have rather pos 
stantial weights in this factor. Test No. ч ite 
a moderate weight and Tests 5 and 19 p 
slight weights. All these tests except No. 5 be 
tests in which concrete objects need 159) ff 
manipulated. Only one test, test No. 5, 15 pun 
ciently different from the others to merit та: 
sideration, but this test has such a weak pop 
Чоп (227) that the rules of evidence rule erra 
having much wcight. One rather AI in 
weak test in this factor is the test employe io 
the PMA series to measure space. This ecu 
several alternatives, either the test does not epa 
ure space, or this factor is not a space media 
it is not the kind of space factor that is ape al- 
by the other tests in this battery. The las Xs 
ternative is believed to be the correct onc. ry 
mentioned above, the visual elements doen d 
to satisfactory performance on tests having with 
stantial weights are primarily concerned. ight 
shape or size, In general, the very slight W pt 
in No. 5 suggests that some people peor. 
this test by means of visual aids. This has dis 
clinical validation in the behavior of og a 
taking this particular test. One need шш, luals 
Very keen observer to notice certain indi onc 
performing on this test by use of sounds aní lips 
can actually see many students moving the ining 
and mouths to suggest that they are сот} 1 em- 
5 words with various vowels to suggest 10 me ig 
selves words to be written. Similarly, оп кот 
serves others looking around to get ideas in 
their immediate environment to aid D 
the test. Similarly, one can easily observe а P test 
ber of people in most groups taking this any’ 
who are “looking” but apparently not at eyes 
thing in particular. Some even close e avior 
but by their expression, manner, and be птопр 
Suggest a visual activity, It is the last Bs in 
which the author feels are achieving ee in- 
the test by the visual aid of seeing words пайса] 
ning with s in their imagery. If the Y date , 
analysis of this test performance can be se ae a 
experimentally or otherwise, it would SUBE ea’ 
somewhat more psychologically oriented ™ fac 
ing for this factor, namely a “visual imagery must 
tor. As limned in this battery, however, We Mg 
on the evidence confine our interpretation of 
Spatial factor in which shape and RR ration 
primary importance. Perhaps further exp a sor 
of this factor may divide people into Erde calls 
of dichotomy as that which the Іаута! 15 
"concrete" thinkers and "abstract" chine a 
it may lead to a division into groups S pately 
auditory types versus visual types. Fort! S 
the techniques of factor analysis do 
these Broups antithetical but merely, | 
pose that they are uncorrelated, at lea 


аы; 
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found in an orthogonal solution. Perhaps of 
some importance in identifying this particular 
factor are slight negative weights in Test 15 
(—.159) and in Test 16 (—-186). In the latter 
tests, visual imagery should not be a handicap 
unless it is a precise sort of imagery. It does lend 
some support, however, to the size and shape 
aspect of the interpretation of this factor because 
one has to allow himself liberty in distortion of 
both these characteristics to achieve adequate 
concepts for better scores. 


C. Facror J 

According to the author's analysis it 
would seem most likely that this factor 
can be most adequately described as 
"judgment." This judgment finds its ex- 
pression in the weighing of hypotheses, 
evaluation of thought materials, criti- 
cism, and discrimination. It finds its ex- 
pression in a wide variety of tasks in 
which control of thinking is of primary 
importance. The latter suggests а pos- 
sible relationship between this factor and 
the concept of maturity or wisdom or 
the things one gains as he gets older and 
Wiscr, perhaps what we call experience. 


This factor has high weights in Tests 8, 3, 9, 
10, and 12, with moderate weights in 1, 17, and 
21, This is obviously some sort of factor revolv- 
ing around the sphere of reasoning. An exami- 
nation of these tests is at first suggestive of some 
Sort of inductive factor since test No. 3 is 
theoretically an induction test as are tests No. 
10, 12, and 21. Similarly, one could present a 
fairly strong case for deduction in terms of its 
expression in Test 8 (the Binet Vocabulary test), 

о. 9, and No. 1, because some analysts have felt 
that in these tests persons bring a wealth of 
material to bear upon solutions by a deductive 
Principle (see French [10] for example) The 
hypothesis of induction is not sustained by the 
Weights that tests have that are readily inter- 
preted as deductive in nature and vice versa. 
кр ed standpoint of an analysis using this 
tio of technique neither induction nor deduc- 

n would appear to be very clearly established. 
ашы i that this name “judgment” serves to 
Which better the differences between tests 
Test ae somewhat similar in character, since 
Weight’ i е Binet Vocabulary test, has a higher 

ne em a Fet i, the PMA vocabulary test. 
situation phi that in the somewhat freer 
to схава. the former that the. subject needs 
trol ao een more discrimination, con- 

» €t. than he needs to in Test 1, in which 


he merely has to choose among several alterna- 
tives instead of the mass of material coming to 
consciousness in the former case. Of the three 
concept-formation tests devised by the author, 
Buttons has the lowest weight, which suggests 
that the fewer limitations imposed upon the rea- 
soning process in this test caused it to be some- 
what weaker than Tests 10 and 12. The greater 
latitude in administration might also have played 
a role, Tests 17 and 18 might also be cited as 
additional evidence. In the first one a trial and 
error performance generally has much less effect 
than a similar performance on Test 18, where 
such a procedure is frequently quite valuable in 
achieving a correct solution—at least for some 
subjects. 


D. Facror Pr 


It is apparent that these tests are ones 
which center around two foci, namely 
speed of operation and fluency of idea- 
tion. Considering the two together, one 
can describe this factor as mental “pro- 
ductiveness.” 


On this factor, tests No. 1, 3, 13, 16, and 18 
had high loadings, while tests No. 4, 5+ 7, 15, 
and(y had moderate loadings. All of the Thur- 
stone tests are represented here except No, 2. 
Just as the amount of flow through a pipe is 
dependent upon the size of the pipe and the 
pressure, similarly mental productiveness is de- 
pendent upon speed and upon a number of 
ideas which come to one's mind that pertain 
to the problem. In tests in which the time is 
unlimited, the weight on this factor would be 
primarily dependent upon one's wealth of ideas. 
In a limited time, however, this factor would 
depend largely upon the degree of speed with 
which ideas reaching a conscious threshold are 
produced. Tests No. 1, 3, 18, 4, 5, and 17 are 
examples of tests in which the speed element is 
of paramount importance. Tests 16, 7, and 15 are 
examples of tests in which the richness of ideas 
causes heavy weights. Test No. 13, it will be re- 
called, was not a speed test and the subject was 
given unlimited time in which to perform. How- 
ever, the instructions for this test were such that 
in essence, this test became a speed test. It is of 
interest that, allowed one's own pace, this factor 
still emerges. It is rather remarkable that some 
of the tests which are definitely speed tests do 
not emerge in this factor. One wonders, for ex- 
ample, why test No. 2, the PMA Space test, does 
not have a high weighting, because the score in 
this test is dependent upon the number of figures 
correctly identified as unreversed in the period 


of time allowed. It is of some interest to note 
that in this test a total of 19 subjects received 
zero scores. This includes, of course subjects 
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whose scores were negative in addition to those 
whose scores were actually zero. Since PMA 
standards were used in the Scoring of this test, 
no attempt was made to evaluate scores below 
zero. In addition to these 19 subjects having zero 
scores, an additional 14 subjects had scores which 
Were so low they might well be attributed to 
chance, This Brouping on the test into two 
divisions, one of which scored significantly and 
а group which scored at a chance level, suggests 
à test which is perhaps too difficult or too crude 
in discriminatory Power to be very useful. Part 
of the failure of this test to emerge with 'signifi- 
cant weight on this factor is perhaps due to some 
of these inherent weaknesses. Another test, in 
Which speed was an element in scoring, that did 
not have weight on this factor was test No. 20. 
It was a rather common observation that among 
persons who worked rapidly on this test, the 
number of errors made appeared to be uncor- 
related with the time, or perhaps was slightly 
negatively correlated. This test, however, does 
have more Weight than its nearest likeness, No. 
19, on this factor. Another test in which a time 
limit was used, not expressed in this factor js 
test. No. 11, in which asked to 
etc. as they could 
Was generally true 
that most subjects would exhaust their thovehts 
after thirty seconds on most of the items o! this 
test. Yet, they were not given an unlimited time 
in which to perform as in tests No, ~ 


in test 
No. 7. It was necessary for the Subject in most 
Cases to give these responses within а reasonable 


10 an oblique solution for the factor, A study 
of the angles (see Table 3) shows that while it 
hasa slight positive correlation with our first two 


factors (“academic” and “spatial”, with some of 


slight negative correlations, 
None of these correlations, however, is sufficiently 


oblique character for this 


*Ona majority of the items in No. 7, however, 
two responses are necessary for maximum credit, 
- 15 and 16 three responses are required, 


consideration in the study, and, consequently, it 
did not emerge in our battery with as eo 
clarity as in a study of this specific area ү 
Davidson and Carroll (9). Their technique 0 
using bot speed and power scores for the зате 
tests reveals this factor with more cera 
While our data do not approach this, it is T 
that in general this factor is fairly cem а. 
in the battery. As they point out, the imp ia 
tions of such a factor are many. Certainly КЕ 
сап по longer afford to make all tests speed е 
ог time-limit tests or power tests. In an adque 
test battery, the common factor variance ur 
nOL be seriously increased by such ur 
of testing procedure, In general, this factor ere 
to be relatively unchanged in shifting from Ta 
type of material to another, It is suggested k x 
failure to take this factor into account has 
sulted in correlations among tests that are a 
cult to explain because they possess a лк, 
element, especially when speed is not a defi 
factor. 


E. Facror C 


With the exception of Test 13, be 
tests are ones which were supposedly 
measures оѓ concept formation—the 
ability to grasp the essential pon 
between discrete variables, to abstrac 
them, and to generalize them. The oe 
of finding the rule or of reasoning fror 
the specific to the general as vaca. 
is apparently a similar way of saying x 
same thing. We have named this paran 
eter the "concept" factor. 


+ the 
This factor was rather weakly identified qe 
test battery, Tests 6, 10, 13, 19, and 21 2 are 
moderate weights. Test No. 3 and test No. E. po 
missing members of the group that was Laity 
thesized as measuring this area. This S о 
Seems to be, in our analysis, limited to E h 
tests in which choice is unlimited. This E Р 
Serve to explain the lack of weight of test - No. 
and the failure of test No. 20 to match pue ol 
19 in loading. Test No. 13 is, in a nuana e 
way, a test of finding similarities and traction 
on а superficial basis called а test of abstr: ирет“ 
of a common element їп spite of a mass of shi h 
fluous perceptual material. Test No: 18. has 
Was hypothesized as a concept-formation ens D 
the characteristic of giving answers in d this 
differences and this may be the reason W ал 
test does not have much weight in a test 
eter. It is perhaps of some significance e nega 
No. 11, a supposedly deductive test, had 
tive weight of —.s00, 


+ 
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F. Facror Rp 

This is operationally described in 
terms of willingness to respond where it 
was largely up to the individual to make 
his own rules of suitability in a deduc- 
uve fashion. It might imply some sug- 
Bestibility or overanxiousness to please 
the examiner, although this was not felt 
to be too important. It is also notable 
for a lack of a critical element in think- 
Ing. We call it “responsiveness.” 
. This factor was neither clearly nor strongly 
identified in the battery, but the weights of the 
tests are rather strongly indicative of good psy- 
chological meaning for this factor. Tests No. 7, 
11, and 15 are weighted heavily in this factor, 
While tests No. 6, 8, 12, 14, and 19 are significant. 
A review of these tests is suggestive of a factor 
Which is perhaps only partly cognitive and per- 
haps partly temperamental in character, Recall 
Of the directions and characteristics of Tests 19 
and 20 will serve as some corroborating evidence 
for description of this factor as “responsiveness” 
since Test 19 allows considerably more freedom 
ОЁ choice and initiative on the part of S. 


" G. Facror B 
This factor is too weakly identified in 
the battery to merit interpretation. It 
appears to be rather complex and is very 
Slightly suggestive of some sort of analy- 
Sis-synthesis dichotomy since its struc- 
ture is somewhat bipolar. During the ro- 
tational process this factor caused a great 
deal of difficulty by its vagaries and it 
Was not until it was ignored that rota- 
tion toward simple structure and orthog- 

Onality was easily achieved. 


H. Facror Fx 


This would appear to be a sort of 
ability to change one’s mental set, or 
Plasticity, or mental flexibility, or ability 
ie try a new tack. It is felt that mental 
flexibility" best subsumes this factor. 
This factor is expressed in tests No. 2, 6, 8, 
M 15, 17, and 21. It was no surprise that test 
n 9- 17 emerged as having highest weight in this 


A e After watching a great number of subjects 
©Mpt to reproduce the designs presented to 


them in this test in a reversed manner in which 
white served as a ground function rather than 
the figure, it was anticipated as some sort of in- 
ability to shift perceptually in terms of figure and 
ground relationships. Test No. 2, Space, as noted 
before, showed a rather remarkable dichotomy 
of distribution in terms of scores. From the au- 
thor's own introspective analysis a great deal of 
shift is necessary to perform adequately on this 
test. The shift here, however, is not in terms of 
figure-ground relationships but is expressed in 
terms of rotational space. Somehow or other, the 
subject who performs well in this test transposes 
the figures among the answers to see whether or 
not they are congruent with the given figures. 
The great distress that a number of subjects 
taking this test always show is indicative of 
their inability to make this transfer. With this 
factor expressed in terms of these two tests alone 
one might assume some sort of a perceptual 
breakdown or analysis involved. Fortunately, 
however, it finds some expression in a 
variety of other tests, such as test No. 6, 
Similarities, and test No. 8, Binet Vocabulary, 
tests in which a considerable verbal element is 
involved. It is felt that the weight of test No. 6 
is primarily due to the ability to eliminate super- 
ficial elements of similarity and to choose more 
fundamental (and better scoring analyses) on the 
earl}? items of this test. On the later items, the 
inability to think in terms of similarities rather 
than differences is one important cause of failure. 
It is very frequently encountered in using a test 
of this particular type that dull subjects will per- 
sist in giving answers such as “they are not alike” 
and regard such an answer as entirely adequate. 
Such a performance is felt to be somewhat char- 
acteristic of people of average ability, too. Al- 
though they realize that some similarity might 
exist, they are so overwhelmed by the number of 
differences that come to mind that they are in- 
capable of correct performance. The weight of 
test No. 8 is somewhat more difficult to explain. 
It is felt to have weight because of a difficulty in 
bringing to consciousness the essence of a defini- 
tion with sufficient clarity to achieve a satis- 
factory response. It is generally recognized that 
multiple-choice vocabulary tests, as test No. i, 
covering a similar range of difficulty, would 
likely result in higher scores than a test in which 
definition is required. The reader with experi- 
ence in any kinds of tests will realize on the 
basis of his own experience that completion items 
are usually more difficult than choice items. It is 
felt that the reason for this is that possible an- 
swers are considerably more numerous in the 
free situation that exists in completion and the 
difficulty of settling on any one answer is con- 
sequently greater. Test No. 14 is a recognition 
of absurdity in pictures. The weighting of this 
test is suggestive of a similarity between this fac- 
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tor and that quality of individuals called a 
sense of humor. One of the characteristics of 
jokes is perhaps the sudden shift of set usually 
involved. Incongruity may be the essence of 
humor and perhaps the person who possesses a 
good sense of humor is one who is capable of 
recognizing absurdity. If this is 50, it is notable 
that one dimension of intelligence or reasoning 
is necessary in order to get the point of a joke. 
Test No. 15, Picture Titles, has weight in this 
factor because of the necessity of the subject to 
think of some other way of describing the picture 
other than in the terms that he has previously 
employed. In general, one response was easy for 
all subjects; some people experienced difficulty 
in giving two Tesponses; a considerable portion of 
the group was unable to give three responses, 
particularly for some pictures. The remaining 
test that had some weight was the Buttons test. 
In this test a different response is required for 
each set of cards and a new and different method 
of grouping must be employed. The persistence 


of memory of previous solutions was generally 
felt to be a handicap for a later performance. 
Those who gave satisfactory responses on some 
of the casier items on this test and were unable 
to recognize that it would be unlikely that P 
same principle would be used later gave. ГЭ 
satisfactory responses, On the other hand, tho 2 
who looked upon cach item as a new challenge, 
with their minds relatively free of prejutiees ар 
parently performed most adequately. It E ӯ 
some interest to note that test No, 21 has greater 
Weight than tests No. 10 and 12. ‘The reason т? 
this is that No, 10 and 12 place somewhat D» 
emphasis and are somewhat less broad in e о 
sense of the number of things to be taken into 
consideration than test No. 21. Test No. 16 
no weight in this factor because of the fact ИШ 
shifts in set resulted, as often as not, in IER 
the Z score. Most frequently the shift took dex 
in terms of location of responsc rather. pue 
terms of organizational ability involved in giv! 

à new response having a high Z loading. 


CHAPTER IV 


A DISCUSSION OF TEST COMPOSITION 


NE ASPECT of the problem in "this 
O study was to discover the factor 
composition of various mental tests, par- 
ticularly those which had not yet been 
subjected to factor analysis, 

In general, the five Thurstone tests in 
the battery do not in our analysis 
emerge as “pure” measures. This is be- 
cause, it is felt, the battery used did not 
have enough tests of a similar nature 


which could combine to allow for 
emergence of the Thurstone factors, 
However, they did show significant 


Weights on some of the factors found in 
this analysis, Tt would thus appear that 
Thurstone’s belief that test 
simple structure in one test battery 
would retain their factor composition in 
other test batteries has not been upheld 
in this analysis. In the author's opinion, 
part of the failure of these tests w 
duced by limitations 


5 rotated to 


as pro- 
of the method of 
test administration, and the type and 
characteristics of the test itself. 


Test No. 1 has significant weights e 
the “academic” factor, the “judgment 
factor and the “productiveness” factor 
In terms of the parameters used in ts 
test it can be described as a measure с 
learned activity that requires discrim! 
nation and evaluation in its solution: 
Test No. 2, the Space test, in this Байы 
was quite complex factorially and e 
expressed in the battery with Hu 
weight in the "judgment" area and wa 
strong loading in mental "Вехи 
Tt also had considerable strength in m 
unknown and unnamed Factor B a 
consequently might be assumed to н 
certain unknown loading. The bso 
Stone Reasoning test, No. 8› has y 
loadings in the “academic” factor, in чий 
"judgment" factor, in the “тайин, 
ness” factor, and moderate weight in a 
unnamed factor. In this respect it pm 
appear to be quite similar to test NO- 4 
in terms of what it measures. Test “ae 
Number, has a high loading on only 
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factor, namely the "academic," and a 
moderate weight on the “productive- 
ness” factor. Test No. 5, Word Fluency, 
measured “academic” ability, “produc- 
liveness,” and had slight weighting in 
the “spatial” factor of this study. 

The Wechsler Similarities test was 
weighted with our "academic" factor, 
With the mental "flexibility" factor, and 


- the "concept" factor. Test No. 7, Com- 


prehension, was most heavily weighted 
in our “responsiveness” factor. It had 
moderate loading also in the “concept” 
factor. Test No. 8, the adaptation of the 
Binet Vocabulary, had expression in the 
‘academic’ factor, the “judgment” fac- 
tor, and the “flexibility” factor. Test No. 
9, Judgment, only found expression in 
the “judgment” area, although some of 
its variability was unaccounted for by its 
inclusion in the unnamed factor. Test 
No. 10, Word Sorting, was a fair meas- 
Ure of "judgment, was among the 
Strongest tests in the "concept" factor, 
and had modest loading in the “aca- 
demic" factor. Test No. 11, Naming 
test, had its chief expression in the “re- 
Sponsiveness” factor. (It had a weighting 
of —.200 on the “concept” factor.) Test 
No. 12, Opposites test, is apparently a 
Moderately good measure of “judg- 
ment,” with slight weighting in the 
“academic,” “responsiveness,” and the 
unknown parameter. Test No. 13, Gott- 
schaldt Figures, was a good measure of 
productiveness? and of “concept” 
ability. Test No. 14, Picture Anomalies, 
Measured mental “flexibility” and to a 
lesser extent "judgment." Test No. 15, 
Picture Titles, measures “productive- 
ness” toa slight extent and “responsive- 
ness” and “flexibility” to a somewhat 
a extent. Test No. 16, Beck’s Ror- 
vei 1 Z score, appeared to be a rela- 
Y pure measure of “productiveness. 

st No. 17, the Steacil Design test, 


turned out to be complex factorially, 
having important weights on the “spa- 
tial” factor, on the “judgment,” and on 
the “flexibility” factor, as well as a lesser 
weight on the “productiveness” factor. 
Test No. 18, Block Designs, measures 
“spatial,” “productiveness,” and to a 
lesser extent “concept” ability and “flexi- 
bility.” Some of its variance was un- 
accounted for by a moderate expression 
in Factor B. The Holsopple Concept 
Formation Test measures “concept” 
ability and “responsiveness.” The Hanl- 
mann-Kasanin test, No. 20, measures our 
“spatial” factor and to a lesser extent, 
“responsiveness” and “judgment.” The 
Buttons test appears to be moderately 
good measure of “judgment,” “concept” 
ability, and “flexibility.” 

In general, the predictions made con- 
cerning the factor composition of new 
test were sustained. Few tests in the 
battery emerge as pure measures of any 
factor, except the Rorschach Z score, 
Picture Titles, and Judgment. This fact 
suggests two things: first, pure measures 
are difficult to construct, and second, our 
factors enter into a broad range of 
human behavior as abstracted in our 
tests. In general, they lose some value as 
differential diagnostic instruments be- 
cause of this fact. The author makes no 
apology, however, for his inability to 
predict or limit his tests to a particular 
factor since the published and widely 
used tests of Thurstone fail to meet a 
similar criterion in this experiment. 

If, as is maintained in this study, fac- 
tors are primarily parsimonious de- 
scriptive phrases of "vectors of the 
mind," it is questionable whether the 
hope or attempt of some factor analysts 
to achieve a set of tests which are pure 
measures of particular factors will likely 
be achieved. Perhaps our approach to 
this dilemma needs modification toward 
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the somewhat old-fashioned statistical 
technique of multiple regression. 

A second alternative is to attempt to 
discover factors which have direct appli- 
cation for particular jobs that the psy- 
chologist must perform. This technique 
has been applied in a number of at- 
tempts to make up a suitable measuring 
and prediction device for vocational 
choice. In the author’s opinion attempts 
to apply the findings of one area to other 
areas of interest to psychologists will 
Prove either futile or inefficient. The 
failure of factorized tests to explain the 
neurotic, the psychotic, and organic be- 
havior disturbances js perhaps due to 
the fact that they are not Specifically de- 
signed for this Purpose. It is not main- 
tained that other tests of intelligence do 
a better job in this respect. It is some- 
times distressing to the psychologist (but 
undoubtedly cheering to the радиу 
to find that very gross destruction of 
cerebral tissues fails to change scores on 
tests. It is especially disconcerting when 
one observes the behavioral changes 
that take place in such cases and yet is 
unable adequately to define them in 
test terms. The failure to place one's 
finger upon the exact nature of changes 
and/or abnormalities of behavior те- 
flects somewhat on our perspicacity as 
students of behavior. 

Another solution to the general prob- 
lem of prediction might conceivably lie 
ina direction of test design, particularly 
by paying somewhat closer attention to 
the administrative characteristics of 


tions to work rapidly have striking 
effects, for example. It would seem feas- 
ible to combine scores. For example, one 
test might give a part score toward a 
"fluency" factor, etc. and another = 
would yield part scores in these e 
other factors. By a method of statistica 
combinations the various weights could 
then be combined to give a more reliable 
measure of the parameters which have 
been found to have some applicability 
to a particular problem. It is concelv- 
able that different combinations of the 
same scores might yield results useful m 
other areas. Again it is felt that the pre- 
scription will have to be specific. e 
hope of finding tests which measure only 
one factor and no other is believed to be 
somewhat more difficult than is к 
monly now realized, especially when оп 


^ һе. 
attempts to deal in the realm of t 


Psychology of the individual. The Ше 
variety of approaches different individ 
uals use in the same tests suggests ч 
important difficulty. One only needs , 
discuss with ten different individus 
how they go about deriving solutions A 
a letter-series test to discover that = 
Some the solution is largely in 
For others it is a primary inductive t 
involving distance, while others see k 
has certain rhythmic characteristics wu 
solve it that way, For perhaps one "E 
ber of the group it might be a test is 
number series, Unless evidence 5 
gleaned from a wide variety of жо 
it is possible that pure measures edit 
certain factor might have vastly differ to 
implications from one individual ts 
another. A variety of sources of ert 
toward a final factor score might mi 
mize this difficulty. f the 
It is difficult to see how some o 
factors identified in this analysis = to 
purified. For example, it is ee 
imagine how the aspects of reaso 
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herein described can be abstracted from 
the contents of the tests themselves with- 
out disturbing the meaning of the factor. 
Reasoning in general must always be 
about certain things and is carried on by 
means of certain symbolic processes. It 
is difficult to see how one-can construct 


a reasoning test that does not use verbal 
material, perceptual material, or con- 
crete objects. Depending upon the type 
of material used, the test might then 
contain factors in addition to those in- 
volved in reasoning. 


CHAPTER V 


CLINICAL VALIDATION OF FACTORS 


ly testing of some individuals 
rather extensive notes were made, 
especially when the subject exhibited 
unusual test behavior as in cases of ex- 
treme difficulty or when he gave evi- 
dence of particular ability. "This was 
done with two purposes in mind. First, 
it offered a means whereby some direc- 
tion could be given in the initial rota- 
tions to eliminate unnecessary work. A 
forecast of eventual factor composition 
was ‘made on the basis of the clinical 
evaluation. 'The number of rotations 
necessary (twelve) is indicative that this 
technique was not without some merit. 
The second reason why notes were kept 
Was an attempt to give some means of 
validating the factors found in terms of 
behavior of individuals since it was felt 
that this might serve as corroborating 
data for the statistical procedures. If 
this sort of empirical validation could 
be made, it was felt that it would insure 
that the factors found would be psycho- 
logically meaningful, and perhaps more 
Important, that they would be useful in 
the sense that they could account for 
deviations in performance. It is generally 
believed that scatter in test performance 
18 primarily due to the differential abili- 
Чез in factors which various individuals 
Possess. It would seem that the converse 
9f this. that individual performance 
ould be accounted fcr by variance in 


factor ability—should also be true. 

From the completed tabulation, the 
scores of six individuals were selected 
without knowledge of meaning of the 
scores by a psychologically unsophisti- 
cated person. These six subjects then 
served as a test group to see if there was 
merit in this belief. 

The scores of these individuals on all 
21 (515 were transformed to z scores in 
order to make them comparable. These 
scores are listed in Table 6. 


The first subject selected had three scores 
which differed by 1.5 standard deviations from 
his average z score of -L.31. These are respec- 
tively Test 3 (—2 standard deviations), Test 7 
(+3 standard deviations, and Test 13 (+1.5 
standard deviation), Test 3 was a test which 
measured the “academic” factor, the “productive- 
ness” factor, and the “judgment” factor. In this 
particular case, other scores measuring the “aca- 
demic” factor are somewhat depressed as are the 
tests in the “productiveness” factor, except for 
those with unlimited time. Scores on the “judg- 
ment” factor are inconclusive here, but there is 
sufficient evidence on the basis of the other two 
factors to account for the majority of the vari- 
ability, Test 7, according to our analysis, meas- 
ures primarily “responsiveness” with a moderate 
weight in “productiveness.” Since scores on the 
“productiveness” factor are somewhat depressed, 
the variability here cannot be accounted for by 
this factor. On the “responsiveness” factor, Tests 
11 and 15 are good measures. The average of 
these two tests is somewhat above the average 
standard score for all tests and probably plays an 
important role in its high weight. However, it 
does not sufficiently account for the extreme 
pen? ag. кк See еи, с! чш 

q ctor, ` productiveness factor, and 
of “concept” formation. Its elevation can be as- 
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sumed to be due to the influence of the space 
element since other space tests are higher than 
average. However, concept formation scores are 
inconclusive. 

In Subject 2, two scores of unusual character 
are present. Test 5 differs from the average z 
Score by more than —1.5 standard deviation, 
while Test g is nearly -+2 standard deviations 
above the average. Since in our analysis, "et 9 
is a relatively pure measure of our “judgnient” 
factor, its variability must be assumed to be due 
to presence to a high degree of such an ability. 
However, practically all of the other tests with 
high loadings on judgment are depressed. There- 
fore, we must regard this assumption as being 
disproven. Test 5, on the other hand, measures 
“productiveness” and the “academic” factor. In 

general, other tests measuring these factors are 
similarly depressed and it would seem to justify 
attributing the variability to these parameters. 

Subject No. 3 has a score on Test 13 which is 

+2 standard deviations above the average. Since 
Test 15 measures "concept" formation, "spatial" 
and mental "flexibility," its elevation would have 
to be attributed to these factors. Examining 
them in turn, it would appear that the spatial 
factor could account for a considerable portion 
of the variance, with some Support from the 
mental “flexibility” factor. Tests of “concept” 
ability do not apparently contribute to the ex- 
planation for this anomalous score since they are 
ambiguous. 

Subject No. 4 has one score On Test 15 at a 
point +2 standard deviations higher than the 
average of his other scores, Test 15, it will be re- 
called, measures "responsiveness" and “flexibil- 
ity.” Since other “responsiveness” tests are slightly 
depressed, the variability here must be attributed 
to the presence of ability to shift or the mental 
“flexibility” factor. The standard scores on other 
tests measuring this factor are considerably above 


average, so this would seem justifiable. 
Subject No. 5 shows one score al 
standard deviations below his average. 
his Test 6 score. Test 6, it will be recalled, vility: 
ures our "academic" factor, "concept" à ‘ified 
and had a moderate weight in an unident 


most —? 
This !5 
meas- 


r “аса- 
3 Я i yr a 
factor, Other scores having weights in erably 
demic” factor are on the average consider j 
he “со 


depressed, while tests having weight on t en 
cept” factor are slightly depressed. The ‘a : 
tion of the two might well account for 
variance. js more 
Subject No. 6. The score on Test 1 i5 


ge 
NA ге avcrag 
than +1.5 standard deviations above Ж 


ral. 
a gener’ 
standard deviations below average. In 5 ac- 


these two tests measure different he 
cording to our analysis. Test 1 measu facto? 
"academic" factor, the “productiveness , factor. 
and to a lesser extent, the “judgment ot only 
Support for the high score in Test 1 is ates on 
lacking but in general is negative. The s¢ are 

other tests of a similar factor compose au g 
general depressed. Test 19, which mennt dn ff 
ment, is depressed as are practically а 

tests measuring this variable. 


na- 
the 


n 
In general, it would appear — 
the basis of these particular cases our 
evidence for clinical usefulness A n 
factors is slightly positive. In 5€ ex 
cases, these factors fail to expla! ten 
treme deviations in scores. Out of cme 
scores selected among the six ae am 
six were readily explained, two ме! what 
biguous, and two were contrary t° test 
one would expect in view of other 


at 
‘ ies А Jt th 
measuring similar factors. It 15 fe 
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the ambiguity of this procedure merits 
further investigation, but it has not been 
proven that our factors are particularly 
useful in this respect. However, no 


means of comparison of the results with 
findings by other investigators are at 
present available. 


CHAPTER VI} 
SUMMARY AND CONCLUSIONS 


d 

AS EXPLORATORY factor study in the 
general area of reasoning ability 

was undertaken to answer à number of 

questions, namely: 

1. Can hypothesized reasoning factors 
be assigned to categories similar to (а) 
Steps in a reasoning process, or (b) logi- 
Cal categories as induction, deduction, or 
(с) such descriptive terms as concept- 
formation ability, problem-solving abil- 
Пу, and analyzing and synthesizing abil- 
чу? 

2. What is the factor composition of 
certain tests which purport to measure 
reasoning or certain aspects of it? 

Another aim of the study in general 
Was to attempt to find factors which 
Her s have more psychological meaning 
ГЇ. sense that they would serve to ex- 
ley Т greater variety of human intel- 
este behavior, and would be more 

y translatable into the descriptive 


concepts frequently used by clinicians. 
The position was taken that factors de- 
scribed in terms of test materials in- 
volved were inadequate and not suffi- 
ciently abstracted to be practical or use- 
ful except in limited circumstances. To 
this purpose, the statistical treatment of 
the data was always made subservient to 
meaning ог usefulness. Two works by 
Meili and Halstead were especially 
recognized as excellent initial efforts in 
this direction. 


A battery of tests was devised. They included 
the five subtests of the Science Research As- 
sociates version of the Primary Mental Abilities 
Test of Thurstone, which were administered in 
group form, and 16 individually administered 
tests. The five factors measured by the subtests 
of the former are: 1. Verbal, 2. Space, 3. Reason- 
ing, 4, Number, 5- Word Fluency. 

The remaining tests were: | 
‚ Wechsler Form II, Similarities 
‚ Wechsler Form II, Comprehension 
‚ An abridged Stanford-Binet Vocabulary test 
. An abridged Test of Practical Judgment 


a 


E 


ow 
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adapted by the author from Cardall's test of the 
same name 

10. A Word Sorting test devised by the author 

11. A Naming test devised by the author 

12. An Opposites test devised by the author 

13. A Gottschaldt Figures test adapted for in- 
dividual administration from the Thurstone Re- 
search Edition 

14. The McGill Picture Anomalies Test, Form 
N, short test 

15. A Picture Titles test devised by the author 


16. Beck’s Z score based on three Rorschach 
cards 


17. An abridged version of the Arthur Stencil 
Design Test 
18. The Wechsler Form II Block Design test 


19. A modification of the Holsopple Concept 
Formation Test 


20. A modification of the Hanfmann-Kasanin 
Concept Formation Test 


21. A Buttons test devised by the author 


The Primary Mental Abilities test, a 
Broup test, was administered to the mem- 
bers of the junior class in a medium- 
sized high school in central Pennsylva- 
nia. From this group, a random selec- 
tion was made of 100 subjects мћо/ уеге 
given the remaining tests in the battery. 
Testing was conducted in the school in 
a suitable location during a period of 
approximately two months immediately 
succeeding the group tests. 

From a correlation matrix, eight fac- 
tors were extracted employing the 
Broup-centroid method as outlined by 
Thurstone. Rotation of these factors was 
made using the method of extended vec- 
tors as outlined by Thurstone. 

The rotations, primarily determined 
by psychological meaning and useful- 
ness, were made toward simple structure 
and orthogonal axes. 

Seven factors were identified as a re- 
sult of these rotations, A remaining fac- 
tor was not capable of being interpreted. 
The first factor, A, was called an “aca- 
demic" or learned activity factor. It 
found its expression in the test battery 
in vocabulary tests, number-computa- 
tion tests, a word-fluency test, a reason- 
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ing test, and others. This factor was be- 
lieved to be similar to a eee 
task” factor of Thurstone and a "centra 


tu : » : al- 
integrative field factor" found in H 


stead's work. 

The second factor, S, was named 4 
“spatial” factor having its chief expres 
sion in the ability to recognize size, 
shape, or congruence. There is sugges 
tion but lack of sufficient evidence tO 
identify this factor positively as some 
sort of visual-imagery factor. It ue 
found in the battery in tests of Blo 
Designs, Stencil Design, Gottschaldt Fig 
ares, and the Hanfmann-Kasanin Соп" 
cept Formation Test. M 

The third factor, J, was called а “7U@5 
ment" factor. It involves discrimination 
ability to weigh and evaluate, to y. 
cise control in one's thinking, and ч 
function wisely as in a mature person 
It had weight in the Reasoning test 9 
Thurstone, the Binet Vocabulary, ni 
the Practical Judgment test, the be 
Sorting test, the Opposites test, the Ste 
cil Design test, and the Buttons ae 

A factor, P, called “productiven®®? 
was primarily concerned with speed asi 
output, although  ideational pa 
played some role. It had weights in p 
of the five Thurstone tests, as well as d 
Gottschaldt Figures test, Beck's Z 5C 
and Block Designs. 

A factor, C, called “concept in 
was weakly identified. It apparently EA 
volves the ability to recognize d 
similarities, to abstract and gener 
to think inductively. It appears n a 
somewhat restricted to tasks in M al 
considerable freedom of choice ter 
lowed. It found expression in the bee 26: 
in a test of Similarities, Comprehen® es 
Word Sorting, Gottschaldt ай 
Holsopple Concept Formation Test, 
the Buttons test. 
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Factor Rp was described as “respon- 
siveness.” It involved lack of criticism, 
some suggestion of willingness to please, 
and was felt to be partly temperamental 


and partly cognitive. Comprehension, 
Binet Vocabulary, Naming, Picture 


Titles, and the Holsopple test had ap- 
preciable weight in this parameter. 

Factor B was the unidentified factor. 

Factor Fx was labeled mental “flexi- 
bility,” or the ability to change one’s 
mental set, or plasticity, ог ability to 
shift. It was identified in Thurstone’s 
Space test, Gottschaldt Figures, Similari- 
ties, Binet Vocabulary, Picture Anoma- 
lies, Picture Titles, and Buttons. 

An attempt to validate the factors 
found in this study by an empirical tech- 
nique based upon explanation of anom- 
alous test scores was slightly suggestive 
of some clinical merit for our factors. 
However, the results were sufficiently 
ambiguous in this respect to state that 
the case has not been proven and further 
investigation is necessary along these 
lines. 

A continued exploration by means of 
factor analysis in the general area of 
reasoning was recommended in order to 
clarify certain of the factors which were 
weakly expressed їп the test battery 
used. 'This applies particularly to our 
"Concept formation" factor and to the 

responsiveness" factor. Further investi- 
gation is also needed to clarify the rela- 
tive roles played by speed and/or аррег- 
Ceptive richness in our “productiveness” 
factor. Our “judgment” factor needs to 
be somewhat more clearly defined. 

Recommendations were made that in 
future studies specific test batteries be 
pned for a particular area, as in 
twm practice, because it Is felt that 

actors found using different ap- 


proaches would have limited usefulness 
or application for such a specific situa- 
tion. The suggestion was made that test 
constructors need to pay greater atten- 
tion to the role of test instructions be- 
cause of their probable effects upon 
factor composition. 

It is somewhat difficult to see how 
some of the factors found in this analy- 
sis can be further "purified." For ex- 
ample, our judgment factor appears to 
enter into a very wide range of be- 
havior. An adequate description of test 
performance would not only include the 
judgment aspects of the test, but would 
also have to include the types of ma- 
terial used in the test itself. The elimi- 
nation of nonrelevant factors would 
seem to be very difficult since some of 
our factors are ones which are apparently 
operative in a wide range of test per- 
fornhnce. Perhaps a more pragmatic 
point of view would be to seek tests 
that have clinical usefulness or readily 
understandable psychological meaning. 

As psychologists, we must be aware of 
the limitations of factor analysis a$ à 
procedure, as well as aware of its possi- 
bilities. The results of this study would 
suggest that there are many ways of 
classifying intellectual performance. Just 
as one can describe an elephant in terms 
of its trunk or legs or ears or tail, so we 
can describe only certain aspects of 
mental life. The only question of con- 
cern to psychologists should be, “What 
purpose does my description serve?” 
Test construction and factor analyses 
should be oriented to this end. 

It is suggested that the parameters em- 
ployed in this study be given empirical 
tests in the clinic to test their practical 
value. 
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CHAPTER I 


THE PROBLEM 


A. TRAINING MEDICAL SPECIALISTS 
As two hundred graduates of medi- 
cal schools enter the Army each 
year for internship training. Many of 
these interns later receive Regular Army 
commissions and take residency training 
in one of the medical specialties. A sub- 
stantial number of Medical Corps officers 
have been certified by an American 

Board as diplomates in some specialty. 

It is desirable that the Army should 
train the best two hundred of the ap- 
proximately one thousand applicants— 
“best” meaning those who will profit 
Most from further training and continue 
to serve satisfactorily in the Army. It is 
also desirable that these doctors shall be 
assigned to the type of training and work 
for which they are best fitted and in 
which they are most interested. 

The research contract between the Sur- 
geon General, U.S. Army, and Stanford 
University specified the “development of 
improved methods of guiding Army 
Medical Corps officers into specialty train- 
ing. Emphasis will be placed on the de- 
velopment of measures of interest, moti- 
vation, and other personal factors, rather 
than on aptitudes or abilities.” As it was 
not known whether medical specialists 
could be separated in this way, the proj- 
ect was restricted to the differentiation 
of four specialist groups, namely, intern- 
S; surgeons, pathologists, and psychia- 
trists. If such differentiation proved suc- 
cessful, further research was contem- 
Plated to differentiate other specialty 
Sroups. 
sare was placed on the develop- 
" m measures of interest as indicative 
Polis a person wants to do and will 

ue to enjoy doing. Research is 


being conducted under other auspices 
relative to aptitudes and abilities which 
indicate what a person is capable of do- 
ing. For example, the Association of 
American Medical Colleges and the Edu- 
cational Testing Service are working on 
improving the methods of admission to 
medical school. 

This project was conceived primarily 
from a guidance, not a selection, point 
of view. The Career Guidance Section of 
the Surgeon General's Office is con- 
tinuously seeking better ways to carry 
out its functions. It was recognized that 
any improved methods developed for 
guiding Army Medical Corps officers into 
specialty training would be equally use- 
ful tq young civilian doctors planning 
рй ге Ам careers. The methods 
developed by this research, therefore, are 
being made available to the medical pro- 
fession. 


B. APTITUDES AND ABILITIES 
Versus INTERESTS 


In selection and guidance what a per- 
son can do is important. But what a per- 
son wants to do is equally important and 
far too often ignored. For example, men 
differ from women very little in intellect- 
ual capacities but they employ their 
abilities in different ways because they 
have different objectives in life—their in- 
terests are different. Graduate students in 
medicine differ very little in general in- 
telligence and scholastic achievement 
from graduate students in business ad- 
ministration, but they have chosen en- 
tirely different careers. Table 1 consists 
of the distributions of scores of physi- 
cians, medical school seniors, and grad- 
uate students in business administration 


ю 


ТАВГЕ т 


PERCENTAGE OBTAINING EACH RATING ох 
THE PHYSICIAN INTEREST SCALE 


Graduate 
Prac- | Seniors Students 
; ticing in in 
Bothy) Scie | МШЕ Щщ, | Business 
cians School Admin- 
istration 
| 
A 45-70 71 73 EE. 
B+ 40-44 13 14 2 
B 35-39 8 $ pou 
B= 30-34 5 4 10 
C 9-29 | $ j 1 83 
Total 100% 100% 1009 


оп the Physician Scale of the Vocational 
Interest Blank. The differences in their 
choices are most clearly indicated in their 
` Scores on the interest blank, Whereas 73 
per cent of the medical Students had an 
A rating, only 1 per cent of the business 
students had such a rating. The mean 
scores are, respectively, 51 and 29. ^ 
The Physician Interest Scale is based 
on the responses of 500 physicians rep- 
resentative of a]] physicians in the United 
States. When a man takes this test, his 
responses are compared item by item 
i of physicians; 
his score expresses how well hi 


agree with those of physicians in general, 


Does a man Possess the same interests 
in later life that he had when he was a 


ts, such as sci- 
and musical interests, 
are surprisingly perma- 
nent. 

The permanence of scores on the orig- 
inal Physician Scale is given in Table 2 


for intervals of one to twenty-two years, 
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These data indicate that the physician 
interest score of a college man is likely 
to agree fairly closely with the scores he 
will obtain many years later. — 
When a college man is attempting | 
decide his future career, he is scored p 
on the Physician Scale alone, m 
many other occupational scales. à 
choice Should be made from ape ie 
cupations on which he has the highe 


TABLE 2 


PERMANENCE Or SCORES c 
PHYSICIAN INTE 


Interval Р: 
in Years | Median 
ices Dates | Between Cor- 
Subject Tested Test | relation 
and 
Retest РРР". 
Colas r sf .85 
College Freshmen 1930-31 I 178 
College Seniors 1927-32 5 177 
College Seniors 1927-37 то .62 
College Freshmen 1930-49 19 ‚64 
College Seniors 1927-40 22 
mop m 
— HÀ ЫШ е е. 


Scores. The data in Table $ indicate gen 
a profile of 34 interest scores will scu 
very closely with a second profile ns 
Up to 22 years later, From a m ате 
Point of view the data in this ta ple 2 
more significant than those in ан the 
as they warrant the expectancy pendet 
relative standing of occupational in 
scores will be remarkably stable. 


TABLE 3 " 
ERES 
PERMANENCE ор PROFILES oF INTER 
Scores (7) E 


— 
Interval ; 
in Years | Median 
* Between| Cor- 
Subjects Dates Test | relatio 
l'ested 
and 
Retest | || 
.88 
College Freshmen 1930-31 + ‚84 
College Seniors 1927-32 5 67 
College Freshmen 1930-39 9 : 2 
College Seniors 1927-37 1o Te 
College Freshmen 1930-49 яз 7 
College Seniors 1927-49 2 


| 
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D. WILL INTEREST Scores PREDICT 
BEHAVIOR? 


Reliability and permanence’ of test 
Scores are important. But the most im- 
portant measure of a test is the extent to 
which it predicts future. behavior. Do 
College men who score high on the 
Physician Scale actually. become physi- 
cians and do those who score low enter 
occupations other than medicine? 

Among 670 Stanford University fresh- 
men of 1930 and seniors and graduate 


TABLE 4 
COMPARISON or PHYSICIAN INTEREST SCORES OF 
OLLEGE STUDENTS WHO BECAME PHYSICIANS 
with Tuose Wuo Dip Nor (8) 


Students Who Became 
Chances 
Physi- | о. Non- in 100 
cian Physicians | physicians | of Be- 
nterest coming 
ating | Num-| Per |Num-| Per |a Physi- 
ber | Cent | ber | Cent cian 
A o |659 | 63 | 11% 53 
B+ 13 13% 56 | 10% 20 
B 10 | 996 | 73 | 1370 | тг 
B- o | 8%| 73 | 13%] 1 
c: S | 5% | 207 | 53% 2 
Total | ro8 |100% | 562 |100% 


Students of 1927, whose occupational 
Careers are known up to 1949, 108 became 
physicians and 562 did not. The distribu- 
tions of their physician interest scores are 
given in Table 4. The mean physician in- 
terest score of those who became physi- 
cians is 47; the mean score of those who 
did not is go, a very large difference. 
Among these 670 students there was a 53 
Per cent chance of becoming a physician 
With an A rating, 20 per cent with a B+ 
rating, 12 per cent with a B rating, 11 
Per cent with a B— rating, and only 2 
Per cent chance with a C rating. When 
all the extraneous factors such as ability, 

€alth, financial status, and family re- 


sponsibilities are considered, it is amaz- 
ing that any test could predict entry into 
medicine to the extent shown. 

Our data actually show a still better 
relationship than that indicated above 
between interest scores in college and oc- 
cupation engaged in 20 years later, Men 
with relatively high physician scores, who 
did not actually enter medicine, def- 
initely did tend to enter occupations 
closely related to medicine, such as den- 
tistry, biological sciences, etc. 

The Physician Scale is designed to 
predict the probability that a person 
would like or enjoy the practice of 
medicine. Since practicing medicine is 
somewhat different from studying medi- 
cine, there are men who like one but not 
the other, Several outstanding students 
in law school have had low lawyer-inter- 
est scores. Later on they entered other 
occu). ations, well foretold by their low 
lawyer scores. Because they were good 
students, they had enjoyed studying law 
but they discovered later on that they did 
not like the activities common to legal 
practice. A medical student with a low 
physician interest score may enjoy medi- 
cal school, but he will probably not enjoy 
medical practice. 


E. Questions REGARDING A MEDICAL 
CAREER 


A guidance point of view implies an 
orientation in terms of the decisions to 
be made by a young man who is inter- 
ested in medicine. There are four ques- 
tions he must answer successively, 


namely: 


Should I be a physician? 

. If so, should I specialize? 

If so, what specialty? 

. What about other activities within 
the medical profession? 


Woes 
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a. Should I Be a Physician? 


This question does not merely mean, 
Does he have the characteristics of a 
physician? It must mean, Does he have 
the characteristics of a physician to a 
greater degree than he has the char- 
acteristics of an engineer, lawyer, ac- 
countant, and all the other occupations 
that college men are likely to enter? To 
answer this question, the college man 
should be scored on a battery of many 
occupational scales. He should seriously 
consider the pros and cons before enter- 
ing an occupation on which he obtains 
a low score. Interest is not the only factor 
in vocational selection, but it is an im- 
portant factor not lightly to be disre- 
garded. 

What is meant by the expression “char- 
acteristics of a physician”? The essence 
of being a physician consists primarily 
of those modes of behavior in which 
physicians differ from other men. The 
only men who should consider medicine 
аз à career are college men or potential 
college men. We are concerned, therefore, 
with only the differences between physi- 
clans and men in the Occupations that 
college men normally enter, not with all 
men in the United States. In developing 
a scale for physician interest, the likes 
and dislikes of physicians are contra 
with the corresponding responses of 
in the Occupations entered by the m 
ity of college men. All items to ү 
the two Broups respond alike are ign 
the only items which are included i 
scale are the items on which phys 
differ from the men-in-genera] gro 


sted 
men 
ajor- 
vhich 
ored; 
n the 
icians 
up. A 


* This men-in 
Р, (рої 


5 Were used and these were 
selected to be терг i i 
cupations that col] 


тиў. 


score оп the Physician Scale indicates 
whether a man differs from men in gen- 
eral in the same manner that physicians 
differ from men in general or whether he 
differs in some other direction. 


b. Should I Specialize? 

Specialization generally requires ei 
years of residency training and Study 
preparatory to passing an (аш 
It also requires the diplomate to restric 
his activities to his own field. The medi- 
cal student must decide whether he de- 
sires this or prefers to enter immediately 
into practice and to handle a wider ne 
of cases. At present about 15 per cent o 
physicians are specialists certified by a 
American Board. It appears likely tiat 
this percentage will double in the next 
twenty years. T 

The essence of being a medical specia 
ist consists in the differences in Benam 
between all medical specialists and al 
medical nonspecialists. The Specializa- 
tion Level Scale is based on such groups 
and measures the differences in interests 
of specialists from physicians in general. 
About go per cent of physicians obtain ап 


A rating on this scale. (See Technical 
Note С.) 


c. If I Am To Specialize, Which 
Specialty Should I Select? 


The four specialty scales for internist 
surgeon, pathologist, and psychiatris 
measure the extent to which the phys 
cian has the interests of men in each Q 
these specialties as distinct from the i" 
terests of physicians in general. 

It is expected that scales for othe 
specialties will be developed. In ш 
meantime scores on these scales will give 
Some idea of how one would score OF 
other specialties, For example, a medic? 
Student interested in orthopedic surgery 


| 
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ought to score like a surgeon and not like 
a psychiatrist. 

Only medical men should be scored 
RA a specialty scales. The scales are 
е ucted that they presuppose that 

i men who are tested have the interests 
uc E No meaning can be at 
es ооо on these scales when the 

s not have the interests of a 
physician. 


d. What About Other Activities Within 
the Medical Profession? 


pni a enjoy and. seek administra- 
ties and etg men dislike such activi- 
mand E them. For example, Com- 
public a tall medical officers score like 
medical administrators, whereas typical 
on such practitioners score much lower 
pected eine scales. It may be eX 

hat a young M.D. with a low 


score on the Physician Scale and high 
scores on the Public Administrator and 
the Office Worker Scales will like ad- 
ministrative work. He will probably 
either seek such work or will gradually 
drift into it as time goes on. Similarly a 
sician with the interests of an aviator 
vork of a flight surgeon. 
scores 


phy 
might enjoy the y 

Other occupational interest 
should be helpful in planning a medical 
r which includes activities not in- 


caree 
atment of patients. 


volving the actual tre 


The reader interested only in the gen- 
eral results of this project and how these 
results can be used by an individual 
might omit Chapters II and III, reading 
Chapter IV next. Those interested in the 

rocedures employed in this research 
should read Chapters II and Ш next. 


à 
(à 


CHAPTER II 


THE DEVELOPMENT OF THE INTEREST SCALES 


А. THE PRIMARY PROBLEM 


HE primary problem of this research 
TEE the differentiation of the medical 
specialists, i.e., to try to answer the ques- 
tion, "What specialty?" It is evident that 
the question, "Should I specialize?” 
should be answered before considering 
a particular specialty. 

Differentiation has reference to dif- 
ferences, not similarities. The essence of 
being a physician consists in having those 
characteristics of physicians not found in 
other men. Physicians possess interests, 
objectives, goals not common to other 
men; they have certain skills which others 
do not have, etc. The sum total of all 
these differentiating characteristios is 
what is meant by being a physician. Dif- 
ferentiation is discussed more fully in 
Technical Note A. 

Differentiation of the medical special- 
ists consists of measuring the differences 
among the several §toups of specialists 
and between Specialists and the average 
physician. We are not considering differ- 
ences in abilities or aptitudes but, rather, 
differences in interests and preferences, It 
is believed that such differences will pre- 
dict continuing to like the activities of a 
Particular specialty. 

This study is restricted to the four 
specialties of Internal Medicine, Surgery, 
Pathology, and Psychiatry, The devices 
used were the Strong Vocational Interest 
Blank for Men and the Medical Special- 
1515 Preference Blank, the latter blank 
having been Specifically developed [or 
this purpose, Briefly, the procedure was 
to administer these blanks to groups of 
Specialists and to reference popul 
of men in general 
eral. Several kinds 


ations 
and physicians in gen- 
of interest scales were 


then constructed on the basis of differ- 
ences in proportions of the various 
groups responding to the different items 
on the blanks. These scales were then 
administered to determine their effec: 
tiveness іп differentiating the several 
groups. 
B. CRITERION AND REFERENCE GROUPS 
In this research a surgeon, for example, 
is defined as a diplomate of the ie 
ican Board of Surgery. Although it would 
not be claimed that all doctors practicing 
surgery are diplomates of the American 
Board of Surgery, it would generally ia 
conceded that all such diplomates are 
surgeons. Similarly, internists, pathol- 
ogists, and psychiatrists were defined as 
diplomates of their respective American 
Boards. : 
In selecting the names for these Ра 
criterion groups from the Directory M 
Medical Specialists (1), the youngest were 
preferred. In the case of foreign-bor? 
doctors, only those receiving their medi- 
cal education in this country were Hr 
cluded. (See Table 5.) . 
In order to determine how the interests 
of specialists differ from those of thé 
average physician, it was necessary tO 
establish a group of physicians as a point 
of reference, The American Medical AS 
sociation provided a list of 2500 names 
randomly selected by machine records 


TABLE 5 
SIZE AND MAXIMUM AGE or CRITERION 
GROUPS OF SPECIALISTS к 
z zi a EU k 
| Intern- | Sur- |Pathol- 19 
| ists | geons | ogists =з = 
Tak. cem E is poem оо 
Number | tooo | хоо | Geo! 1? 
ear of Birth | T 
of the Oldest | того | 1907 | 1900 | 
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TABLE 6 
— = NUMBER or BLANKS USED IN ITEM COUNTS 
n s | | Patholo- Psychic Physici 
" | Internists | Surgeons | an sygniar Physicians 
=, Е Е gists trists in General 
Vocational Inte "o — БЫР =, | 
Medic. terest Blank оо o | 5 
сна Specialists Preference | 3 | T vti | bk | - 
300 | зоо 200 | 300 | 400 


fr TEM 

ria ihag of all physicians in the 
relerence руз This physician-in-general 
M (Point p will be referred to as 

езе о reference—medical). 
est scales eae ae of occupational inter- 
twenty-five ii en developed in the past 
terest Ded x for the Vocational In- 
based m ed Most of these scales were 
men in th omparisons with a group of 
tend to a кшн that college men 
correct he * his was considered the 
were desig, we group since these scales 
lege nin iie primarily for use by col- 
їп иени ж reference group of men 
and Л. de hin" on over 4500 blanks 
беоне referred to as Рем (Point of 
men). 


C. INTERES 
NTEREST AND PREFERENCE BLANKS 


ran ag Vocational Interest Blank 
CUpations бо of 400 items, such as oc- 
activities, school subjects, amusements, 
The Бег rV peculiarities of people. 
cating эке. tested responds by indi- 
ifferent to her he likes, dislikes, or is in- 
Nas been es of the items. This blank 
Some fift idely used for many years and 
Shee ages scales have been 
Згоцр, using the Pmen reference 
елы primary objective is to dif- 
and betwe among the medical specialists 
average foe each specialty group and the 
ank de осто, it Was believed that а 
Medical signed specifically for use by the 
profession might be particularly 


i 
S 
Se footnote 1, Chapter I. 


effective. Various hunches or rationales 
prompted the development of the differ- 
ent types of items. It was postulated that 
there would be systematic differences 
among the four types of medical special- 
ists regarding their preferences for type 
of professional associate, medical school 
subjects, casual acquaintances, and de- 
scriptions of occupational and recrea- 
tional activities. Biographical items re- 
ferring to family and personal back- 
ground were included. 

The Medical Specialists Preference 
Bla was assembled from items tried out 
with doctors at three Army hospitals. It 
consists of 171 items, more than half of 
which are of the forced-choice type which 
does not permit an "indifferent" re- 
sponse. The development of this blank is 
described in Technical Note E. 


D. CoLLECTION OF Basic DATA 


'The Vocational Interest Blank was 
mailed to the four medical specialist 
groups in September 1949 and to the 
physicians-in-general group in May 1950. 
The Medical Specialists Preference Blank 
these same groups in Sep- 
tember 1950. The 3600 doctors in the 
four medical specialist groups returned 
the Vocational Interest 
per cent of the Medical 


was mailed to 


48 per cent of 


Blanks and 42 
Specialists Preference Blanks. 


The basic data required for the con- 
n of interest scales are the per- 
h group marking the re- 
each item. Item 


structio 
centages of eac 


spective choices under 
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counts were made of responses to the 
Vocational Interest Blank and the Medi- 
cal Specialists Preference Blank by each 
of the four medical specialty groups and 
by the physicians-in-general group. The 
number of blanks used in each group is 
shown in Table 6. Other blanks that were 
returned were used for cross validation as 
reported in Technical Note F. 


E. Tue INTEREST SCALES FOR 
MEDICAL SPECIALISTS 


The methods used in developing the 
various scales as well as the technical 
problems involved are described in detail 
in Technical Note В. In this section only 
a brief summary will be given of these 
procedures. 

In constructing scales to measure dif- 
ferences between two groups, each item is 
assigned a weight on the basis of the 
difference in the percentages of/:ach 
group responding in a given way. For ex- 
ample, if a larger proportion of the sur- 
geons than physicians in general like to 
play golf, then a response of "Like" to 
the item "golf" on the Vocational Inter- 
est Blank would be given a positive 
weight on the Surgeon Scale. 

It is obvious that many different types 
of comparisons can be made, each of 
Which could result in an interest scale. 
Scales based on different points of refer- 
ence could be constructed for each of the 
Specialist groups. Scales could use either 
the Vocational Interest Blank, or the 
Medical Specialists Preference Blank, or 
both blanks combined. 

A Physician Scale using the Vocational 
Interest Blank and based on differences 
between a group of physicians and the 
men-in-general reference group has been 
available for many years. A revised 
Physician Scale using the Р 


mea Teference 
group as the criterion was о 


me of the first 


scales constructed on this project. An in- 
dividual’s score on this scale indicates 
whether his interests are more like those 
of physicians or more like those of men in 
occupations ordinarily entered by col- 
lege men. This revised Physician Scale 
is described in Technical Note D and is 
based on a more recent and representa- 
tive sample of physicians than was the 
original scale. 

Using only the Vocational Interest 
Blank, scales were constructed for each 
of the four medical specialist groups 
based, first, on the Prien (men in general) 
reference group and, second, on the Pmea 
(physicians in general) reference group. 
As had been expected, the intercorrela- 
tions among the four scales based on 
Pas (average r = .86) were much higher 
than among the four scales based on Pmea 
(average T = .28). That is, when com- 
pared to men in general, internists, sur- 
geons, pathologists, and psychiatrists аге 
much more alike than when they are 
compared to physicians in general. These 
relationships indicated that only scales 
based on the physicians-in-general refer- 
ence group should be used for differ- 
entiating medical specialists. 

It was found that scales using both the 
Vocational Interest Blank and the Medi- 
cal Specialists Preference Blank were su- 
perior to scales using either blank alone. 
Interest scales using both blanks and 
based on differences between each of the 
four medical specialist groups and the 
Pas (physicians in general) reference 
Sroup Were constructed. These scales dif- 
ferentiated Very well between the special- 
ist groups and the physicians in general 
(average т, = 81) and fairly well among 
the four specialist groups (average Тыз = 
-67). 
The poorest differentiation was on the 


Internist Scale between internists and 


ee m 
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р athologists (This = .43) and between in- 
ternists and psychiatrists (fis = -23)- Are 
the Interests of internists very similar to 
the interests of psychiatrists and pathol- 
ation is the relative failure to dif- 
а ate caused by faulty scales? In 
‚order to answer this question, scales were 
Irae based on direct comparisons 
eina Ec six pairs of medical special- 
аан. Pie ке with these scales 
еген that it should be possible to 
ond igen internists from pathologists 
Kaas d psychiatrists almost as well as 
g the other specialist groups. 

i attempts were made to improve 
АЙ oey з between internists 
ani шт and between internists 
four peso ios As stated. above, the 
нений анун medical specialist scales 
ae a differences between each 
[mes nana and the physicians-in- 
бее] оре = group. A procedure was 
ater : selecting those items on the 
ienie eta es which met certain require- 
Á— “ap reference to discriminating 
leta he four specialist groups. These 
ie CHa scales were substantially 
entiating b the original scales in differ- 
Ей i: 2 internists and psychia- 
ternists 4 = .58 vs. 23) and between in- 
and pathologists (Tis = .56 vs. 

48). 
jn, oe otherwise indicated, the Intern- 
tiisi P i Pathologist, and Psychia- 
Boe ie es referred to in this report are 
P aa scales using both the 
cal Rte Blank and the Medi- 
One еа Preference Blank. Р 
obs. r scale has been developed. 
Patholo е of the internists, surgeons, 
as а кеп 5, апа psychiatrists, considered 
tasted pri aus. of specialists, are con- 
Physicians a the interests of the Pmea 
le testis їп general) reference group. 
ing scale is called the Speciali- 


zation Level Scale. Certain preliminary 
investigations suggest that scores on this 
scale may identify individuals who will 
enjoy taking further specialized training 
and narrowing the field of their profes- 
sional work. The development of the 
Specialization Level Scale is described in 
Technical Note C. 


F. INTERCORRELATIONS OF SCALES 
AND RELIABILITY 


One measure of the goodness of inter- 
est scales for purposes of discrimination 
is based on the intercorrelations of such 


TABLE 7 


INTERCORRELATIONS OF MEDICAL SPECIALISTS 
ScaLes (№ = 100 PHYSICIANS IN GENERAL) 


ioi Selected- 
Scale Correlated po oe Item 
Scales 
Intergist vs. Surgeon , —.04 —.84 
Inter Ast vs. Pathologist -64 .05 
Internist vs. Psychiatrist PG ic .04 
Surgeon vs. Pathologist TI —.17 
Surgeon vs. Psychiatrist | —.20 —.46 
Pathologist vs. Psychiatrist .42 .05 
Average E —.17 


scales. The lower the intercorrelations, 
the better the scales. A high positive cor- 
relation between two scales means a per- 
son obtaining a high score on one scale 
would tend to get a high score on the 
other scale. That is, scores of individuals 
on the two scales would tend to be equal. 
With a correlation of zero there would 
be no relationship between the scores of 
individuals on the two scales. A high 
negative correlation gives the best dif- 
ferentiation since individuals getting 
high scores on one scale tend to get low 
scores on the other. 

Table 7 gives the intercorrelations of 
both the original scales and the selected- 
items scales. The improvement with the 
selected-item technique is apparent with 


10 


a reduction of the average intercorrela- 
tion coefficient from -27 to —.17. The 
Surgeon Scale correlates negatively with 
each of the other three and the other cor- 
relations approximate zero. 

Estimates of the reliabilities of the 
scales were obtained by correlating scores 
on the odd-numbered items with scores 
on the even-numbered items and correct- 
ing by the Spearman-Brown formula. 
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The resulting reliability estimates for the 
scales on both blanks combined are: In- 
ternist Scale -69, Surgeon Scale .79, 
Pathologist Scale .89, Psychiatrist Scale 
‘89, and Specialization Level Scale .79. 
These reliabilities are considered accept 
able. The problem of reliability is dis- 


cused in more detail in Technical 
Note F. 


CHAPTER III 


DIFFERENTIATION OF GROUPS 


А. STANDARD SCORES AND LETTER RATINGS 
Ib ORDER to make comparisons between 
biis Breups on the various in- 
man wa S, 1t 1s necessary to have com- 
scores 2 of measurement. Standard 
п зз established for all scales by 
eral es he mean of the criterion group 
Seal за i аф the standard deviation 
different n RR standard scores on the 
M ы scales are thus directly 
Бб? will hs Any score given in this re- 
ira iud € a standard score unless other- 
1cated. 
М ratings from A to C have been 
cupation oe years to express oc 
tional = terest scores on the Voca- 
responde ar Blank. An A rating cor- 
above, a к standard scores of 45 and 
falis -F rating to scores of 40-44, à 
C mic 10 35-39, a B— to 30-34, and a 
1 8 includes scores of 29 and below. 
fs aoe the meaning of the let- 
what E> it may be helpful to consider 
w PM en of the criterion group 
it Would ps each rating. For example, 
made b i expected that the scores 
Would 7 U on the Surgeon Scale 
follows: A istributed approximately as 
4%, and Ан. ан 15%» B 9% Б 
8Toups а 2%: ost of our criterion 
quite cl approximate this distribution 
B osely. 
Tn Pria scores and letter ratings 
between ini © describe the differences 
interest $ he various groups. The use of 
cales for individual guidance 


will 5 ч : 
fep. discussed in Chapter IV of this 


B. 
MEASURES or OVERLAPPING 
AND CORRELATION 


In 
© 4 М " n ; 
Omparing the distributions of in- 


B 


terest scores made by two groups, a meas- 
ure of the overlapping has been found 
useful. Overlapping is defined as "the 
percentage of scores made by one group 
which could be matched with scores in 
the other group." Table 8 shows one way 
of estimating this overlapping and in- 


TABLE 8 


OVERLAP OF MEDICAL AND NONMEDICAL 
STUDENTS ON THE PHYSICIAN 
INTEREST SCALE 


> 
Per Cent | Ei Per Cent* 


suae | of Seniors ir | of Overlap 
Rating jin Medical ed of Two 
School Students Groups 
A | 73 | II II 
B+ 14 10 IO 
& 18 I5 | 13 
р, à | we | 4 
С rÉ d w9 | I 
Total 100% | 100% | 39% 


* The smaller of the 2 per cents represents scores com- 
mon to both groups and, hence, the overlap. 


dicates that medical school seniors and 
nonmedical college students overlap on 
the Physicians Interest Scale about 39 
per cent. A formula by Tilton (9) gives 
practically the same result and is easier 
to use. This formula was used in comput- 


ing all the estimates of overlap in this re- 


port. | 
This example indicates that the per- 
pping can be consider- 


centage of overla 
able even with two groups that are quite 


sharply differentiated. It may be helpful 
to consider the overlap of other groups 
on other scales. Engineers overlap on the 
Engineer Scale with other occupational 
groups as follows: chemists 6595, physi- 
cians 42%, accountants 36%, and life 
insurance salesmen 10%. Accountants 
overlap on the Accountant Scale with 
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Per 
[Per С B— B B+ A cent 
cent Е ens 
70 З Specialists 
L 60 
60 т 
SPECIALIZATION LEVEL SCALE Р 
50 ~ 
| ala 
S 
40 eu 
30 
30 | Е Г 
^ Pmed 


Fic. 1 
Differentiation with the Specialization Level Scale 
Per cent obtaining each letter rating. 


A 
Specialists — АП internist; surgeo: 


Pau = Physicians. 


bankers 62%, Personnel man 
carpenters 43%, farmers 


ministers 14% (5, p. 109Е.). 
It should b 


agers 47%, 
26%, and 


у is preferable 
he tota] Situation, 


ns, pathologists апа Psychiatrists 
Seniors — Medical schoo] seniors 


in-general reference Broup 


be roughly approximated as follows: vis 
:90 = 30% overlap, rj, „ғо = 50% over 
lap, rj, .50 = 70% overlap, and тыз -30 
= 9076 overlap. Note that the higher the 


5 s PE c- 
Tvis the better is the differentiation b 
tween groups. 


е Je 
С, DIFFERENTIATION WITH THE SPECIAL 
ZATION LEVEL SCALE 

: Tm ts 
The Specialization Level Scale reflec 
the differences 
Considered as 


Figure 1 indicates graphically the ү, 
centage of Specialists, physicians in per 
eral, and Medical school seniors Өш 
ing each letter rating on the 2 
tion Level Scale. The points on the figu! 
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representing the percentages in each 
category are connected by lines to facili- 
tate reading. For example, the,ratings of 
the specialists are distributed as follows: 
A rating 69%, B+ rating 17%, B rating 
ќо» B— rating 5%, and C rating 1%. 
A larger proportion of the medical 
School seniors than of the physicians in 
general have an A or B+ rating on the 
Specialization Level Scale. This relation- 
ship suggests that younger doctors have 
More of the interests of specialists than 
do older physicians. (See footnote to 


Table 27.) 


D. DIFFERENTIATION WITH THE FOUR 
SPECIALIST SCALES 
The four scales, Internist, Surgeon, 


Pa ; P 
tthologist, and Psychiatrist, are based 


eral have an A rating on the Internist 
Scale. At the other end of the scale, C 
ratings were obtained by 25 per cent of 
the physicians in general and only 3 per 
cent of the internists. Similar informa- 
tion is given for surgeons, pathologists, 
and psychiatrists with respect to their 
own scales. Table 9 describes these com- 
parisons in another manner. 

The differentiation of the four medical 
specialty groups from the physicians-in- 
general group is good with an average 
overlap of 42 per cent. If we assume that 
our specialist scales are reasonably good 
measures of the interests of the specialists, 
we can make certain estimates. For ex- 
ample, the proportion of the physicians- 
in-general group having interests similar 
to those of internists is larger than the 


TABLE 9 


Dirre TIATION OF THE Four SPECIALIST Groyrs FROM PHYSICIANS IN GE 
" | A | Biserial 

Scale | Groups Compared | Overlap | Correlation 
— - | Sk 
Internist | Internists and Pmea* | 48 | 73 
Surgeon | Surgeons and Pa | 42 | 8 
Pathologist Patholog and Реа 37 | -83 
Psychiatrist | Psychiatrists and Pmea | 41 | бо 
| Average | 42 | “79 


*р, 
оета 
med = Physicians-in-general reference group. 


oa aa the Vocational Interest Blank 
Blank шы Specialists Preference 
in inten lese scales reflect the differences 
geons Ms of groups of internists, sur- 
Supe; eee and psychiatrists as 
With 8. to physicians in general and 
these es ег, Тһе effectiveness of 
8roups ed im differentiating the various 
„PS will now be examined. 

eae а indicates graphically the dis- 
8епега] n of internists and physicians in 
ample Ey the Internist Scale. For ex- 
Only a3 per cent of the internists and 

Per cent of the physicians in gen- 


proportion having interests similar to any 
of the other three groups. This apparent 
relationship seems reasonable. The activi- 
ties of internists appear to resemble those 
of the average physician more than do 
the activities of surgeons, pathologists, 
and psychiatrists. 

How well do the scales differentiate 
among the four medical specialist groups? 
Figures 3 and 4 indicate graphically the 
percentage of each specialty group ob- 
taining each letter rating on each of the 
four scales. These charts are very similar 
in shape to those in Figure 2. This 
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Ratings 
c B- B B+ A 


Ratings 


ERNIST SCALE SURGEON SCALE 
INT. 


*-———-Pmed 


Internists 


Differentiation of Specialist 


Groups from Physicians in General 
ning each letter rating 


Per cent obtai 


Pag = Physicians-in-genera] reference group 


„+ 
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TABLE то 
DIFFERENTIATION AMONG THE Four SPECIALIST GROUPS 
Scale Group | % іѕегі 
roups Compared 9 Biserial 
Р P Overlap* Correlation 
Internist Internists vs. Surgeons 31 .9о 
Internists vs. Pathologists бт .56 
Internists vs. Psychiatrists 60 .58 
S * 
urgeon Surgeons vs. Internists 24 .95 
Surgeons vs. Pathologists 31 ‚80 
Surgeons vs. Psychiatrists 18 +99 
В н " 
athologist Pathologists vs. Internists 53 .66 
Pathologists vs. Surgeons 44 .76 
Pathologists vs. Psychiatrists 42 +79 
Psychiatrist асі i 
sychiatrist Psychiatrists vs. Internists 57 -63 
Psychiatrists vs. Surgeons 38 .83 
Psychiatrists vs. Pathologists 46 .75 
Average 42 E 


NC) 
verlap computed by Tilton's formula (9). 


er -— the scales differentiate among 
well as ams of specialists about as 
from the y са еасһ specialist group 
TH is sub physiciansit genera, group. 
бастан рар in Table 10 which 
avers api the average overlap and 
ева. iserial correlation coefficient are 
кн е same as in Table 9. 
RS ка appear to be the most homo- 
edie unique of the four medical 
of inter s. The overlap of the interests 
and наснаги with those of psychiatrists 
even pw ogists is the largest. However, 
tanda read differentiation is sub- 
ies ^s ти correlation of .56 (the 
validity { able 10) represents a high 
average M most testing procedures. The 
resents к correlation of .78 rep- 
nical Not eam effectiveness. (See Tech- 
Validatio е F for consideration of cross- 
P n data.) 

б чна of estimating the effec 
Well the 588 scales is to consider how 
specialty, ва specialists to their own 
Of the Жа 9r example, what proportion 

rnists will score higher on the 


Internist Scale than on the Surgeon Scale, 
what proportion will be tied, and what 
proportion will show more of the inter- 
ests of surgeons? Such comparisons are 
indicated in Figure 5. It should be noted 
that the “In Error" percentage undoubt- 
edly contains some who actually should 
have been in another field on the basis 


of interests. 


E. DIFFERENCES AMONG THE Four 
SPECIALIST GROUPS ON OTHER 
OCCUPATIONAL SCALES 


Further differences between the four 
specialist groups are indicated by the 
scores on other occupational scales on 
the Vocational Interest Blank. These 
scales have been widely used for voca- 
tional guidance and were developed on 
the basis of differences between criterion 
groups in these occupations and the Pmen 
(men in general) reference group. Aver- 
age scores made by each of the specialist 
groups are shown in Table 11. 

Specialists average slightly higher on 
the Physician Interest Scale than do 


i 
Е Ж. STRONG, JR., AND A. C. TUCKER 
Per | 

B B+ A cen 
Per С B— | n 
cent : | 
70 + j И 

5 

к / L 50 
80 + INTERNIST SCALE j 


Differentiation amo 


ng Specialist Groups with 
nd Surgeon Scales 
aining each letter rating 


Internist a 
Per cent obt 


I~ Internists, N= 291 Ра — Pathologists, N= 124 
S= Surgeons, N= 246 


S = Psychiatr ists, N — 202 
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c B— 


BY 


PATHOLOGIST SCALE 


PSYCHIATRIST SCALE 


Q 


I = Internists, N = 291 
S = Surgeons, N — 246 


Fic. 4 


Differentiation among Specialist Groups with 
Pathologist and Psychiatrist Scales 


Per cent obtaining each letter rating 


Pa = Pathologists, N = 124 
Ps — Psychiatrists, N = 202 
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Correctly placed Cl Tied SS In error 


Group Scales 


— 291 


Internists 


N 


246 


Surgeons 
N 


124 


Pathologists 
N 


N= 202 


Psychiatrists 


I= INTERNIST Ра = PATHOLOGIST 
S= SURGEON Ps = PSYCHIATRIST 


i Ес, 5 
Per Cent of Each Specialist Group Correctly Placed 
by Comparison of Scores on Two Scales 


Physicians in general. T 


hey appear to Е, Resurts WITH GROUPS or 
have few of the interests of office workers OTHER SPECIALISTS 
or life insurance salesmen Psychiatrists 
tend ү 


i Can the Scores of other types of spe 
nterests of cialists on the medical specialist scales x 

О» personnel man. Predicted on the basis of appe 
agers, and Psychologists than the other similarity of activities? Tt was postulated, 
three Specialists, These relationships 


for example, that orthopedic — 
fact that the urologists, and neurological in ors 
© more like Would score higher on the Surgeon pin 
those of the than on any of the other three scales. hat 
the other hand, it was believed th 


interests of Pathologists ar 
those of chemists than are 
other specialists, 
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TABLE 11 
MEAN Scores or SPECIALIST GROUPS ON OTHER OCCUPATIONAL SCALEs* 
(Based on Vocational Interest Blank) 
Ф. 

Scales Internists Surgeons Pathologists | Psychiatrists 
Physician (rev.) 52 52 52 51 
Public Administrator 42 40 41 46 

ffice Worker 24 24 22 23 
ersonnel Manager 32 31 29 39 
Math-Science Teacher 37 36 38 37 
Sychologist 41 36 2 46 
hemist 41 40 46 39 
ЫЕ Insurance Salesman 26 27 22 28 
Author-Journalist 37 34 37 37 
Aviator 31 35 33 31 


* 
Standard Deviations roughly approximate 1o. 


“ег Rating Equivalents: A=45 and above, В+ —40-44. B 733-39. B— =30-34, C =29 and below. 


Mera would tend to score high on 
1 Internist and Psychiatrist Scales. 
e" order to check these statements, 
Ortho, were mailed to diplomates in 
ea] поред Surgery, Urology, Neurologi- 
ie eet and Pediatrics. The results 
Fa ri n in Table 12. On the Surgeon 
the т b ne orthopedic surgeons score 46, 
rologists 41, and the neurological 


surgeons 45. The average scores of these 
three groups on the other three medical 
specialist scales are all lower. Also as pre- 
dicted, the pediatricians score highest on 
the Internist and Psychiatrist Scales. 
"YAese results definitely support the be- 
lief that scores on the four medical spe- 
cialist scales can be used to estimate the 
interests of other groups of specialists. 


TABLE 12 
MEAN Scores or GROUPS or OTHER SPECIALISTS* 
Orthopedic Dictostses Neurological | pediatricians 
Scale Surgeons x Surgeons re 
Nese N=82 Nee N=86 
Physician (rev.) 5I 49 53 51 
pecialization Level 44 A2 52 we 
Internist 31 33 36 44 
pirgeon 46 41 45 22 
athologist 33 33 41 35 
Sychiatrist 33 33 35 41 
Public Admini 8 I 42 
ministrator 41 3 4 
ce Worker 26 27 23 26 
€rsonnel Manager 31 29 32 32 
Math-Sci 8 6 o 
Scie; 3 3 4 
Sychologist теше V 32 38 дт 
hemist 30 38 43 39 
Life Insy 6 2 2 
rance S. 2 2 4 5 
т тыш ca 31 34 34 
Viator 39 36 35 31 


7 Standar 


d Deviati i 
Letter Ratin, eviations roughly approximate СНО B =35-30, B—=30-34, C =29 and below, 


g Equivalents; A —45 and above, 
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TABLE 13 | | 
MEAN Scores or Grours or NONSPECIALISTS* T 
po к | © мл d | 
ki Medical ; 7 Command г 
Physicians School iw Staff Medical \ 
Scales in General Seniors N=186 5 | | 
N=100 N=150 і N=67 
Physician (rev.) 50 st " 
Specialization Level 39 4 
i 4 o 3o 
Internist 36 34 E 28 
Surgeon * 31 31 31 j е 
Pathologist 30 1 k 33 
Psychiatrist 33 38 - Е 
8 
Public Administrator 36 39 + Fi 
Office Worker 24 2 31 t | 
Personnel Manager 27 32 33 EN 
I 
Math-Science Teacher 34 | 41 43 37 
Psychologist 33 | 36 | 34 27 
Chemist 37 | 36 | 36 | 
Life Insurance Salesman 28 28 28 31 
Author-Journalist 35 32 29 2 
Aviator 32 38 39 


* iations rough] ximate то. : 

etter Rating atoms rough sand арыы By 74 B= 35-30, B= 30-34, Cao and below. 

С. RrsurTs WITH GROUPS oF 
Nonspecrauists 

In addition to th 

€ral reference grou 


medical school seniors are very small. | 
This indicates that the young doctors en- 
өлө ri шу for internships are 
€ physicians-in-gen- m the Army eyes авї 

really representatiy all medical < 
P there are three rea у representative о Ё[ ш | 
lists for which data  Sraduates with respect to interests. 


4 T 7 older 
are available, Approximately 750 seniors 138 differences „чия жй pd the 
in fifteen medical schools completed the Physicians-in-genera group vei ot j 
blanks in the spring of 1951. These Younger medical school seniors are n 
a 51. À 
blanks were collected 


l primarily for the great and may merely represent differ- 
+ n $ i 

Purpose of a long-time follow-up study, ©nces in emph 

However, 


asis in medical education. 
; For examp] is a for the 
а representative sample of 150 example, there is д tendency f 


blanks (every fifth blank) has been scored, Young doctors to have interests ca oa 
All interns in Army hospitals also com. those of Psychiatrists, math-science teac я 
pleted the blanks in June 1951, A group 01% and aviators than their older co 
of officers in the Army Medical Service leagues. "T" - g 
who are performing primarily Command . rue des КИНЕ alae cbe 
and Staff functions was identified by the nés = к, of the Command үн ihe 
Office of the Surgeon General; blanks n dia deviate oe шашай this 
have been returned by 67 of this group. pL: eng Pg. Log doctora " car- 

The mean scores of these Nonspecialist ~ iens ij, he іп actual : it 

Nites Я Ing for patients, Most of them have pe 

Broups are given ір Table 13. The differ. tions of responsi 
ences between the Army interns and the 


bility in the administra- 
tion of medical 


facilities or in making ^ 
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NL a = 
Sees 
Fic. 6 
Comparisons of Command and Staff Group 
with Physicians-in-General Group 
(Scales on Vocational Interest Blank) 


Per cent obtaining each letter rating 
Cands = Army Command and Staff Medical Officers Group, 


Pmea = Physicians-in-general reference group. 


22 E. К. STRONG, JR., AND A. C. TUCKER 


plans at higher headquarters levels. Some 
inquiry suggests that most of these doc- 
tors actually sought administrative work 
or at least offered little resistance to such 
assignments. 

Figure 6 presents clearly the large dif- 
ferences between the physicians-in-gen- 
eral group and the Command and Staff 
group. It appears that only about a third 
of the Command and Staff group now 
have the interests of physicians while 
four out of every five of them get an A 
or B+ on the Public Administrator 
Scale) Differences between the two 
groups on the Office Worker and Person- 
nel Managers scales are equally pro- 
nounced and in the direction we would 
expect. 


The differences. between groups on 


^s 


the various interest scales which have 
been discussed in this chapter suggest 
that interest scores may be used with 
some confidence by an individual in 
planning his career. How such results 
can be reported and used by an individ- 
ual will be discussed in the next chapter. 


* The data in Table 13 and Fig. 6 concerning 
the Command and Staff group pertain to their 
interests as of "now." Whether or not their 
interest scores have changed from the time they 
Were medical students is, of course, unknown. 
Table 2 indicates that physician interest scores 
are fairly stable over a period of 22 years. —— 

Because these men have gone into admini- 
strative work, it is possible that their interests 
have shifted from clinical to administrative ac- 
tivities and the interest scores reflect such а 
change. Most data do not support this view 
but rather that existing interests are reflected 
in occupational activities. 


: 
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CHAPTER IV 


PRACTICAL USE OF INDIVIDUAL SCORES 
o 


A. REPORTING MEDICAL INTERESTS 


Te man who completes the Voca- 
tional Interest Blank and the Medi- 
cal Specialists Preference Blank wants an 
answer to one or more of the following 
four questions: 

4. Should I be a physician? 

b. If so, should I specialize? 

с. If so, which specialty? 

d. What about other activities within 

the medical profession? 

The Report of Medical Interests will 
assist ап individual in answering these 
questions by providing ratings on various 


‘scales (copy in Appendix). This report 


form has undergone several revisions 
after experimental use with physicians, 
interns, and medical students. It is a 
compromise between what may be de- 
sired by the research man, on the one 
hand, and by those relatively unfamiliar 
With psychological tests on the other 
hand. Two pages of information briefly 
answer questions which have been asked 
by medical men regarding their scores. 

Scores are reported in terms of the five 
letter ratings, A, B+, В, B—, and С, as 
defined in Chapter III. For the individ- 
ual, these ratings may be considered as 
€xpressions of the probability that he has 
the interests of men in the listed occupa- 
tion. An A rating represents a high prob- 
ability and gives a "Yes" answer to the 
question, “Does he have such interests?" 
Similarly a B+ rating means “Probably,” 
а B means "Possibly" a B— means 
"Probably Not," and a C rating means 
"No, he does not have such interests.” 

* There is substantial evidence that the higher 
а man's vocational interest score the greater the 


Probability that he has the interests of men in 
that Occupation (5). The use of words such as 
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‘There are always a few men in each 
occupation who receive a C rating on 
their own occupational scale. Several 
analyses of such cases indicate that many 
of these men do not enjoy their work; 
others pursue atypical activities, such as 
superintendent of a hospital or health 
officer, where they no longer treat pa- 
tients but do maintain membership in 
the medical fraternity. 

Figure 7 is a copy of the Report of 
Medical Interests sent to an Army in- 
tern. His ratings suggest: (а) that he 
should be a physician, (b) that he should 
specialize, and (c) that of the four spe- 
cialists, he should become a surgeon. His 
actual scores on SURGEON and Psycura- 
TRIST are 52 and 36 respectively. As the 
difigsence is greater than 10, an "X" is 
recorded under “10+, yes" in No. 7, in- 
dicating that the SURGEON score is de- 
finitely higher than the PsvcnurATRIST 
score. His scores on the supplementary 
occupational interest scales (No. 8) ap- 
proximate those of the average physi- 
cian; ie. they fall within or very close 
to the shaded areas, except on aviator 
interest, on which he obtains an A rating. 

'The shaded areas under No. 8 assist 
in interpreting interests in other activi- 
ties within the medical profession. For 
some purposes it is well to consider how 
one's interests compare, not with men 
engaged in the ten occupations, but with 
doctors alone. The shaded areas provide 
the basis for such comparisons. Twenty- 
five per cent of physicians score above the 
shaded area, 50 per cent score within the 
shaded area, and 25 per cent below this 


“Yes,” “Probably,” and “Possibly” to represent 
intervals along the gradient of interest scores has 
been found useful in understanding these scores 
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REPORT OF MEDICAL INTERESTS 


5 


By 


Possibly Probably 


L 


2. Medical specialists? . 


And of the four groups of specialists 
considered: 


3. INTERNISTS? ... 


> 


4. SURGEONS? 


6. PSYCHIATRISTS? 


A 


7 


Where two or more 
to (b) as follows: 


а. SURGEON.......... p, .ESYCHIATRIST 


8. Your Vocational Interest Blank has been 
be helpful to you, 


a. Administrative Interests 
Public Administrator 
Office Worker |. 
Personnel Manager 

b. Teaching and Research Interests 
Math-Science Teacher ... 
Psychologis| 


C. Persuasive Interests 
Life Insurance Salesman... 

d. Linguistic Interests 
Author-Journalist 

е. Aviation Interests 
Aviator 


Fic. 7 
Medical Interests of an Army Intern 


area. (It should be 

of shaded areas is 

range of chance scor 
regular Report on 

Blank.) 


As an example 


noted that this use 
different from the 
€s indicated on the 
Vocational Interest 


» if a man’s rating on 


office worker 


he 
he 


workers tha 
cians. Such 


lik 


Specialists interests scores are about equal, your interests are more similar to (a) than 


Probably 


sapa on other scales and this supplementary information may 
ў ee Ren 


A 


is a B, it means that possibly 
terests of office workers; but 
has more of the interests of paar 
n the great majority of physi 
a score suggests that he d 
€ administrative work, or at least dis 


has the in 


= 
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TABLE 14 
AVERAGE RATINGS OF OTHER SPECIALISTS ON MEDICAL SPECIALISTS SCALES 
Orthop£&ic : i Neurological Vo 
Scales Ск кк Urologists Surgeons Hediatricians 
№61 Меде N=43 ll 
Internist B- B— B B+ 
Surgeon A B+ A G 
Pathologist B- B— B B— 
Psychiatrist B- B- B B+ 


like it less than most doctors. All ad- 
ministrators spend much of their time 
handling letters and report forms, the 
work of an office man. 

It should be noted that scores on the 
four medical specialist scales (No. 8, 4, 5, 
and 6) should not be considered unless 
one has the interests of a physician. 
These scores are meaningless if one rates 
C or B— on the Physician Scale and ques- 
tionable if one has a B rating. Since these 
Scales were based on differences between 
groups of medical specialists апа physi- 
cians in general, they presume a real in- 
terest in the medical profession as evi- 
denced by a high score on the Physician 
Interest Scale. The meaning of scores on 
these scales for other groups is extremely 
problematical. 

The Specialization Level Scale (No. 2) 
appears to be most useful in those cases 
having high ratings on No. 1 and low 
ratings on No. 3, 4, 5, and 6. Such scores 
Suggest that one has the interests of 
medical specialists but not of one of the 
four for which scales have been con- 
Structed. Since there are some 32 recog- 
nized specialties in medicine, it would 
appear advisable to investigate carefully 
some of the other specialties. 

How well will scores on the four spe- 
cialist scales predict interest in other re- 
lated fields? The specialties of urology 
and orthopedic surgery, for instance, ap- 
pear to have much in common with the 
field of general surgery. Similarly cardiol- 


ogy and dermatology appear closely re- 
lated to internal medicine. It would 
appear reasonable to expect the interest 
scores in the four major specialty fields 
of internal medicine, surgery, pathology, 
and psychiatry each to represent the areas 
of related activities fairly well. 

Data for four other types of specialists 
are given in Table 14. As was expected, 
the orthopedic surgeons, urologists, and 
neurological surgeons definitely tend to 
score, higher on the Surgeon Scale than 
on “е other three medical specialist 
scales. The higher average ratings of the 
pediatricians on the Internist and Psy- 
chiatrist Scales had been predicted on the 
basis of the professional activities of this 
group. This evidence, while not conclu- 
sive for all types of specialists, certainly 
supports the belief that a doctor con- 
sidering any one of the many medical 
specialties would be aided by consider- 
ing his results on the scales now available. 


B. INTEREST PATTERNS OF GROUPS 

Average ratings of physicians in gen- 
eral, senior medical students, Army in- 
terns, and Command and Staff officers 
in the Army Medical Service are in- 
dicated in Table 15. The first three 
groups have average ratings of A on 
physician interest, higher than on any 
other scale, which is to be expected. The 
Command and Staff doctors score only 
35 on the Physician Scale, barely a B rat- 
ing, which is indicative of the fact that 
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TABLE 15 
AVERAGE RATINGS OF NONSPECIALIST Groups on REPORT OF MEDICAL INTERESTS 
prd d 
an 
Physicians . Medical Army Interns SO ical 
Interests Similar to— in General SH Senin N=186 Officers 
N=t100 N=15 N=67 
B 
т. Physicians A A A 
2. Medical specialists B B+ B+ B+ 
Specialists o 
3. Internists B B— B = B a 
4. Surgeons B- B- g= BL 
5. Pathologists B— G D 
6. Psychiatrists B— B B 
8. Other occupational scores 
a. Administrative Interests " 
Public Administrator B B B4- 
Office Worker C С [: B 
Personnel Manager G B- B= B+ 
b. Teaching and Research 
Math-Science Teacher P B+ B+ B 
Psychologist B- B B— C 
hemist B B С 
с. Persuasive Interests 
ife Insurance Salesman C e © B- 
d. Linguistic Interests 
Author-Journalist B- Ві: с g 
e. Aviation Interests a 
viator = B B B= = 
TABLE 16 


Per Cents HAVING INTERESTS To Spr 


CIALIZE BASED on A RATINGS ON PHYSICIAN SCALE, 
SPECIALIZATION LEVEL SCALE, 


: AND ON ONE oF THE SPE 


CIALIST SCALES 


Ply Type of Specialist Total 
Internist Surgeon Pathologist Psychiatrist 
Medical School Seniors 6 g 
Army Interns 3 3 { 16 25% 
ommand and Staff Officers 


6 25% 
9 3 3 i 3 9% 
they differ from other physicians. 


All four grou 
on the Specializ 


answer to this 
what Standards 
whether g mans 
We require A г 


question depends ngon 
are used in determining 
hould specialize or not. І 
atings in physician and spe 
cialization interest and an A in one of the 
four specialist scales, then we have the 
data in Table 16, The results, if we ies 
the requirement to include those with 
either A or B+ ratings on the three scales, 
are shown jn Table 17. d 

As was to be expected, the oo 
and Staff group contains a much smalle 


ә. 4 
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TABLE 17 


PER Cent HAVING INTERESTS TO SPECIALIZE BASED ON 


А ов B+ RATINGS ON PHYSICIAN SCALE, 


SPECIALIZATION LEVEL SCALE, AND ON ONE OF THE SPECIALIST SCALES 


RJ 


Type of Specialist 


Group = zT Total 

Internist Surgeon | Pathologist | Psychiatrist 
Medical School Seniors 15 10 6 22 53% 
Army Interns 8 Il 6 28 53% 
Command and Staff Officers I 4 6 8 19% 


proportion of doctors who should special- 
ize than do the other two groups. On the 
basis of interests alone, somewhere be- 
tween one-quarter and one-half of the 
medical school seniors and Army interns 
should seriously consider specialty train- 
ing. When other factors in addition to 
interest are considered, these proportions 
Will be reduced appreciably. 

It appears that a substantially larger 
proportion of the young doctors repre- 
sented by these two groups have the inter- 
ests of psychiatrists than of the other 
thrée specialists. Is this relationship 
caused by a faulty psychiatrist scale, or 
does it represent a real difference in inter- 
ests of young doctors as compared to 
Older ones? Reference to Table 9 indi- 
cates that both the Internist and the 
Surgeon Scales show less differentiation 
between the criterion group and the 
physicians-in-general group than does the 
Psychiatrist Scale. Since differentiation is 
one measure of the effectiveness of a scale, 
the Psychiatrist Scale is considered satis- 
factory. Table 13 shows the average score 
on the Psychiatrist Scale for the seniors 
and interns to be about six points higher 
than for the physicians in general. It thus 
appears that the younger doctors do tend 
to have more of the interests of psychia- 
trists than do the older doctors. Also, 
Army interns seem to have more of the 
interests of psychiatrists than do medical 
School seniors. 


C. EXAMPLES ОЕ INpivipuaL RECORDS 


It may be helpful in understanding the 
use of these blanks to consider the rec- 
ords of a few individual cases. In Figure 7 
was given the record of a man who meets 
all the interest requirements as to entry 
into medicine and specialization in sur- 
gery. Our data suggest that at least one- 
quarter of the young doctors will find 
that their interests indicate they would 
enjoy the advanced training and the nar- 
roWirs of professional activities required 
ofa specialist. 

Table 18 (Doctor Y) gives the record 
of a Command and Staff Medical Corps 
officer with a very low score in Physician 


TABLE 18 


RATINGS OF Two COMMAND AND STAFF 
MEDICAL Corps OFFICERS 


Scale Doctor У | Doctor Z 
Physician (rev.) Cc A 
Specialization Level B B+ 
Internist — B 
Surgeon | E B+ 
Pathologist -- C 
Psychiatrist — B+ 
Public Administrator A A 
Office Worker B+ © 
Personnel Manager A B+ 
Math-Science Teacher B- B-— 
Psychologist С B 
Chemist © je 
Life Insurance Salesman B B 
Author-Journalist С Be 
Aviator С В 
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interest, A ratings in Public Administra- 
tor and Personnel Manager, and a B+ 
rating in Office Worker. He does not 
treat patients and is an Outstanding ad- 
ministrator. 

Assuming that this man's interest scores 
have not changed appreciably since he 
was in medical school? we may ask, 
should this man have entered medicine? 
He has long since ceased to practice. But 
if he had not become a physician, he 
would not have risen to a prominent 
administrative position in the Army 
Medical Service. On the other hand, if he 
had entered some field other than medi- 
cine, he would probably have risen to an 
administrative position in that other area, 
Maybe it would have been а more impor- 
tant position than the one he now holds. 

Should the Army take a man with this 
interest record for internship? The 
answer is “No” if they want him ‘ape 

? See footnote 1, Chapter III, 
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tice medicine. If the Army wants doctors 
who are eventually to become adminis- 
trators, it would seem preferable to take 
a man witn an interest record similar to 
Doctor Z (see Table 18). This Command 
and Staff officer has an A rating on both 
Physician and Public Administrator 
scales. While he has made a fine record 
as an administrator, he devotes much of 
his time to clinical work. 

In selecting Army interns a minimum 
requirement could be established for the 
Physician Interest Scale. If an А rating 
had been required, 76 per cent of the pres- 
ent class of interns would have been 
selected. ОГ those selected, 41 per cent 
would also have A ratings in Public Ad- 
ministrator, If the requirement had been 
an A or B+ rating on the Physician Scale, 
then 86 per cent of the present group 
would have been eligible, with 7o per 


cent of them having an A or B+ rating 
in Public Administrator, 


Le 


CHAPTER V 


SUMMARY AND CONCLUSIONS 


A of medical school 
graduates enter the Army each year 
to Serve their internship, and many con- 
tinue through residency training in one 
of the medical specialties. These doctors 
should be assigned to the type of training 
and work for which they are best fitted 
and in which they are most interested. 


number 


To aid in making such assignments, the 
Surgeon General, U. S. Army, requested 
the “development of improved methods 
of guiding Army Medical Corps officers 
into specialty training. Emphasis will be 
placed on the development of measures of 
interest, motivation, and other personal 
factors, rather than on aptitudes or 
abilities," 

This project was conceived primarily 
from a guidance, not a selection, point 
Ol view. It was recognized that any im- 
proved methods developed for guiding 
Army Medical Corps officers into spe- 
cialty training would be equally useful 
to young civilian doctors planning their 
professional careers. 

There are four questions that must be 
answered by a young man interested in 
à medical career, namely: (a) Should I 
be a physician? (b) If so, should I special- 
ize? (c) If so, what specialty? (d) What 
about other activities within the medical 
profession? One important aspect of these 
questions involves job satisfaction and 
con tinuing high motivation in the work. 
Obviously, there are other aspects of 
these questions, such as aptitudes, abili- 
ties, and financial support, which were 
not considered in this research. 

The results of several extensive follow- 
up studies of Stanford students extend- 
ing up to эз years were presented as evi- 
dence that scores on the Strong Voca- 
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tional Interest Blank do have consider- 
able permanence and predict vocational 
behavior quite well. The Physician Inter- 
est Ratings of 670 Stanford students, of 
whom 108 were physicians twenty years 
later, were considered. Those students 
with an A rating in physician interest 
had 53 chances in 100 of becoming 
physician; with a B+ rating, 20 chances; 
B rating, 12 chances; B— rating, 11 
chances; and with a C rating, only 2 
chances in 100. These studies lead one to 
expect that similar measures of interests 
of medical specialists would be useful in 
planning a medical career. 

The primary problem of this research 
was to develop measures of interest and 
othei ypes of preference which would 
differentiate the various types of medical 
specialists. Based on the evidence in- 
dicated above, it was believed that such 
measures would be predictive of con- 
tinuing to enjoy working in a particular 
specialty. Only the four major specialties 
of Internal Medicine, Surgery, Pathology, 
and Psychiatry were studied. 

The criterion groups consisted of dip- 
lomates certified by the American Boards 
in these four specialties; i.e., a surgeon 
was defined as a diplomate of the Amer- 
ican Board of Surgery. А physicians-in- 
general reference group was randomly 
selected by the American Medical As- 
sociation from their lists of all physicians 
in this country. 

Two blanks were used for measuring 
interests. The Strong Vocational Interest 
Blank has been used for 25 years to meas- 
ure the vocational interests of many dif 
ferent occupational groups. The Medical 
Specialists Preference Blank was de- 
veloped specifically for use by the medi- 


a 


Do p 


cal profession. Many of the items on this 
blank relate directly to the practice of 
medicine and more than half are of the 
forced-choice type, which does not permit 
an “indifferent” response. These items 
were first tried out on doctors in three 
large Army hospitals. 

Each of these two blanks was mailed 
at different times to 1000 diplomates in 
each of the specialties of Internal Medi- 
cine, Surgery, and Psychiatry, and to 600 
diplomates in Pathology. The initial 
mailing to the physicians-in-general 
group was 2500, but this Was greatly re- 
duced by the subsequent elimination of 
Women and doctors over 55 years of age 
in the origina] listing. The samples on 
which item counts were made approxi- 
mated 400 for each of the criterion 
Sroups. Data were also collected on 
smaller samples of the following: or- 
thopedic Surgeons, urologists, neuro) vei- 
cal surgeons, pediatricians, medical 
school seniors, Army interns, 


Command and Staff medical 


4 Were assigned to each 
Te scales w 


oup and from the 
as found to be 
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cialists: Internist, Surgeon, Pathologist, 
and Psychiatrist. 

Two other scales were developed, The 
item counts of the physicians-in-general 
group on the Vocational Interest Blank 
were used to construct a revised Physi- 
cian Scale for use with that blank. This 
scale contrasts the interests of physicians 
with men in general and assists in an- 
Swering the question, "Should I be a 
physician?" (See "Technical Note D) 

A Specialization Level Scale was con- 
structed based on the differences between 
all of the Specialists, considered as a 
group, and the physicians-in-general 
Sroup. This scale was designed to help 
„тег the question, “Should I special- 
ize?” (See Technical Note С.) 

The results, in terms of differentiation 
between groups, can be summarized as 
follows: 

1. А larger Proportion of the medical- 
School seniors than of the physicians-in- 
general group have an A or B+ rating 
on the Specialization Level Scale, This 
relationship suggests that younger doc- 
tors have more of the interests of spe- 
Cialists than do the older physicians. 

2. The Internist, Surgeon, Pathologist, 
Scales each differentiate 
Cup from physicians-in- 
Xceptionally wel] (average 
‘is = 79, range -73 to :83). These four 
scales also differentiate among the four 
Oups very well (average "vis 
€ .56 to :99). Surgeons appear 
most homogeneous and unique 
py the four medical specialists, The over- 
lap of the interests of internists with 


those of Psychiatrists апа pathologists is 
the largest, 


3. It was Postulated that orthopedic 


Surgeons, urologists, and neurological 
га. ка would average higher scores ОП 
the 


Surgeon Scale than on the other 
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three scales. It was also believed that 
pediatricians would score highest on the 
Internist and Psychiatrist Scales. These 
hypotheses were definitely supported by 
the data on samples of these four spe- 
cialists. In every case the average ratings 
on the other scales were at least two rat- 
ings lower than on the scales postulated 
to be high. 

4. The three groups of nonspecialists 
—that is, medical school seniors, Army in- 
terns, and Army Command and Staff 
medical officers—average a B rating or 
less on the four medical specialist scales. 
"These groups, as a whole, would not be 
expected to show the interests of a spe- 
cialist group. 

5. The Vocational Interest Blanks 
Were also scored on several of the regular 
interest scales which contrast the inter- 
ests of occupational groups with men in 
general. The psychiatrists tend to have 
more of the interests of public adminis- 
‘ators, personnel managers, and psy- 
chologists than the other three specialists. 
The interests of pathologists are more 
like those of chemists than are the other 
Specialties. 

6. Among the groups of nonspecialists, 
the Army Command and Staff medical 
officers group deviates markedly on the 
regular interest scales from the other 
groups. It appears that only about a 
third of the Command and Staff group 
now have the interests of physicians, 
while four out of five get an A or B+ 
on the Public Administrator Scale. Aver- 
age scores of this group on the Office 
Worker and Personnel Manager Scale 
are substantially higher than for the 
other medical groups. The doctors in this 
group spend little time in actually car- 
ing for patients. Most of them have posi- 
tions of responsibility in the administra- 
tion of medical facilities or in making 


plans at higher headquarters. 

The Report of Medical Interests was 
designed for use in reporting an individ- 
ual's scores in such a way as to be most 
useful in his own planning. Scores are 
reported in terms of the five letter rat- 
ings, A, B+, B, B—, and C, which may 
be considered as expressing the probabil- 
ity that he has the interests of men in the 
listed specialty or occupation. An A rat- 
ing means “Yes,” a B+ rating means 
"Probably," a B means "Possibly," a B— 
means "Probably Not," and a C rating 
means "No, he does not have such in- 
terests." The use of these results by an 
individual will be considered with refer- 
ence to the four questions he must an- 
swer.? 

a. Should he be a physician? An A or 
B+ rating on the Physician Scale sup- 
ports his belief that he would enjoy the 
priige of medicine. A rating of B or 
lower suggests he should consider other 
occupations. 

b. If so, should he specialize? A high 
score on the Specialization Level Scale 
indicates he has the interests of a spe- 
cialist; i.e., he would probably enjoy the 
narrowing of his area of professional 
activities as well as the further training 
required of a specialist. 

c. If so, what specialty? An A or B+ 
on the Internist, Surgeon, Pathologist, or 
Psychiatrist Scale indicates he probably 
has the interests of that type of spe- 
cialist, provided he has at least an A or 
B+ on the Physician Scale. Since these 
scales measure the differences between 
specialists and physicians in general, the 
scores have no meaning unless one has 
the interests of a physician. While scales 


*See footnote 1, Chapter IV. 

? Other factors besides interest, such as apti- 
tude, ability, and social need, must also be con- 
sidered, 
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are available for only these four medical 
specialists, it is believed that these results 
can be used with some confidence to 
estimate how one's interests would prob- 
ably correspond with those of other types 
of specialists. For example, cardiology 
and dermatology appear to be closely 
related to internal medicine. Such use of 
these ratings is definitely supported by 
the findings for orthopedic surgeons, 
urologists, neurological surgeons, 
pediatricians, 

d. What about other activities within 
the medical profession? 
devote little or no time 
of patients but, rather, 
activities as teaching, 
administration, 
marketing 


and 


Some physicians 
to the treatment 
engage in such 
research, hospital 
preventive medicine, 
medical supplies, ete. The 
Scores on the ten occupational scales on 
the Vocational Interest Blank may be 
helpful in considering many of t - 
ous activities within the medical profes- 


Sion. In addition to letter ratings in- 
dicating how one’s interests compare with 
those of men in these occupations, shaded 
areas are marked to indicate the range 
of scores made by the middle 50 per cent 
of the physicians-in-general group. For 
example, if his rating on the Office 
Worker Scale is a B, he possibly has the 
interests of office workers: but he has 
more of the interests of office workers 
than the great majority of physicians. 
Certain problems of methodology are 
discussed in detail in the six Technical 
Notes. The principles of differentiation 
and point of reference are elaborated in 
Technical Note A, A new method of 
selecting interest items so as to maximize 
differentiation among several criterion 
5ї0црѕ as well as between the criterion 
group and the reference group is pre- 
sented in Technical Note B. The other 
four Technical Notes other 


discuss 
aspects of the research, 


TECHNICAL NOTE A 


DIFFERENTIATION AND POINT OF REFERENCE 
* 


1. Differentiation 
IFFERENTIATION has reference to dif- 
ferences, not similarities. The es- 
sence of being a physician consists of 
having those characteristics of physicians 
not found in other men. The sum total 
of all of these differentiating characteris- 
Ucs is what is meant by being a physician. 

Differences exist between two or more 
things. In this research the things are 
groups of men, Such groups may be 
likened to spheres. The center of each 
sphere is the mean score of a test; the 
radius is expressed in terms of the stand- 
ard deviation of the scores. Such spheres 
are not to be thought of as isolated in 
Space but, rather, as overlapping one an- 
other. The better the differentiation the 
farther apart are the centers of the 
spheres and the less the spheres overlap. 

On several occasions lists have been 
prepared of the characteristics of success- 
ful men in various occupations such as 
presidents of corporations, foremen, sales- 
men, etc, Such lists contain almost identi- 
cal items. Little is gained by use of such 
lists, for all men, according to these lists, 
are far more similar than different. If an 
understanding of successful presidents is 
desired, the characteristics that distin- 
guish such men from unsuccessful presi- 
dents, or vice-presidents, or from fore- 
men, must be obtained. 

In differentiating two groups it is neces- 
sary, first, to note the characteristics that 
distinguish them from each other and, 
second, to use devices to measure these 
characteristics. If the difference is a mat- 
ter of stature, a tape is employed; if it 
is mathematics, an achievement test is 
used; if it is interests, an interest or pref- 
erence blank is utilized. 
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The characteristics that differentiate 
two groups are present in individuals in 
both groups but in varying degree. The 
interest test of masculinity-femininity 
takes into account both mechanical in- 
terests possessed by men more than 
women and linguistic interests possessed 
by women more than men. Three lists 
of differentiating characteristics would 
need to be employed in the three cases 
where surgeons are contrasted with all 
M.D.'s, all college graduates, and all men 
in the country. 


2. Point of Reference 


If one is asked to comment on some 
coins, ranging [rom cents to silver dol- 
lars, Re tells you that they differ in size, 
coló value, and metal composition. If 
he is asked to comment on the contents 
of a desk drawer, he mentions coins, rub- 
ber bands, paper clips, pencils, etc. If the 
request is made about one's study, the 
reply is desk, books, chairs, etc. In each 
case the individual unconsciously reacts 
in terms of the center of all the things 
to be noted. In the first case, the cent is 
smaller than the dollar. In the second 
case, all the coins are grouped in con- 
trast to pencils, etc. In the third case, the 
coins are not mentioned, nor are the 
other contents of the drawer—they are all 
grouped into the term "desk," for every- 
thing in the room is noted in reference to 
the room as a whole. 

Differentiation of groups of men is con- 
cerned not only with the peculiarities of 
the two groups, but also with points of 
reference. In differentiating medical spe- 
cialists they are viewed as deviants from 
all medical men. They can also be 
thought of as deviants from all profes- 
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== 
/ othetical Relationships 
Ко, с and Points of Reference 


A,B,C,D = Medical Specialist groups 


Paed = Physicians-in., 


ence point 
Phen = Men-in-general reference point 


general refer- 


vo points of reference 
are used. The question, “Should this man 
be a physician?”, а Does he have 
the interests of a ici 


Ot concern our- 
Ot attractive to 


TABLE 19 


Correlations Represented by Figure 8 


" Part 1 


int 
Physicians-in-general reference poin 


i i Angle in Correlation 
Relationship ak erasa (angle cosine) 
A = Prog - B 59 .51 
A= Pug = С 162 -.95 
A-Pan 233 -.® 
B- Paea -C 101 =.20 
B - Ped-D 163 -.96 
C- Ред -D 64 43 

Average -.31 
Se 
Part 2 


Men-in-general reference point 
Relationship Angle in сосала ы, 
degrees (angle cosin 


——_—____Sterees (angle cosine) _ 


A= "ET. 10 299 
A= Pron = б 32 .85 
Am Buoni D ho л1 
B = Phen = С 22 93 
B= Prien = D 30 «87 
Cm В епі D 7 „99 

Average „90 


in 
college men, The point of reference i 


this case is an average of the men p 
gaged in the Occupations attractive p 
college men, This point of reference a 
designated as Pmen-? It may be considere 
as the center of al] the occupations vis 
college men might consider entering. ч 
is also the center of all the young vin 
who might consider medicine as a d 

* Second point of reference is use 

* See footnote 1, Chapter I. 
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in connection with the question, “Which 
specialty should I enter?” This question 
can be stated: “Аге my interests those of 
specialists; and if so, in which specialty 
would I most enjoy the work?" The only 
persons concerned with this question are 
practicing physicians, interns, and medi- 
cal students. The point of reference is 
accordingly a physician-in-general group, 
referred to here as P mea: 

In order to show how the statistics here 
employed measure the relationships ex- 
pressed above with regard to Pmen and 
Pmcas Figure 8 is presented. This diagram 
is not drawn to any scale, nor based on 
Specific data, and is presented solely to 
give a general idea of certain relation- 
Ships. Ре is shown at the bottom of the 
figure and Р in the center. The four 
letters, A, B, C, and D, represent four 
groups of medical specialists. 

When interest scales are constructed 
differentiating the interests of medical 
Spécialists from Р, the scales may be 
represented by the lines A-Pmea B-Pmea 
С.Р леа, and D-P,,,4. Since each scale rep- 
resents the differences in interests of phy- 
Sicians and a group of specialists, the in- 
terests pertinent to medicine are elimi- 
nated and the scale represents only the 
characteristics in which the specialty 
group differs from the average physician. 

Correlations between the interests of 
two specialist groups—i.e., between A and 
B, A and C, A and D, B and C, etc.— 
are, strictly speaking, not between the 
two types of specialists but involve Реа 
also. The correlations are actually be- 
tween (a) the differences in interests of 
A and Ршеа and (b) the differences in in- 
terests of B and Р. In such a situation 
the correlation coefficient is equal to the 
cosine of the central angle, ie., to the 
angle A-P,,,-B. The angles between the 


six combinations of A, B, C, and D and 
the corresponding cosines of these angles, 
which equal the correlations, are given 
in Part 1 of Table 19. 

If interest scales are constructed differ- 
entiating the interests of medical special- 
ists not from Pmea but from Р, the 
scales may be represented by the lines 
АР, „ағ ВР. Саз. ТУР... Here the 
interests peculiar to all men іп occupa- 
tions entered by college men are elimi- 
nated. But the interests of physicians as 
such are not eliminated and all four 
scales represent the differences between 
P,,, and the interests of the average 
physician, modified somewhat by the 
variations in interests of the four spe- 
cialties. When Groups A to D are con- 
trasted in terms of Pmen, the angles are all 
acute and so the cosines and correlations 
approximate 1.00, as shown in Part 2 of 
Тад P 

The” Physician Interest Scale used to 
measure the interests of young college 
men who are considering which occupa- 
tion to enter is represented in the dia- 
gram by the line PmeaPmens The angles 
between Pmea-Pmen-A, Pmea-Pmen-B, etc. are 
all very acute angles. Hence the correla- 
tions will be high, which is appropriate, 
since the interests of physicians and of 
medical specialists are quite similar. The 
intercorrelations between scores of physi- 
cians and scores of the four specialist 
groups average .96 in the diagram, higher 
than the intercorrelations among the four 
specialist groups, when considered in 
terms of Pmen (average .90). This relation- 
ship appears reasonable since specialists 
will agree more closely with all physicians 
than will each specialist agree with other 
specialists. 

Table 19 gives two sets of correlations 
between specialists (A and D) which are 


36 


E. К. STRONG, JR., 


AND A. C. TUCKER 


TABLE 2o 


INTERCORRELATIONS OF SCALES ON Ti 


HE VOCATION. 
DirrERENT POINTS or 


(N= 285 Stanford Seniors), 


AL INTEREST BLANK BASED ox Two 
EFERENCE 


| Scales (Pos Reference Point) 


Scales (Piet Reference Point) 
Scales um ee : | 
I | s Pa Ps I S l'a Ps 
Internist — | -909 | -927 | .846 | == dj se ] -305 | 
Surgeon -909 — -899 | .592 | «324. a d ЖШ 
Pathologist | -927 .899 — | 770 | +365 | n8 - мі 
Psychiatrist | -846 329? | жу — -508 | +234 о 
| Average = , 


- very different, The members constitutir 
the specialist Sroups are identical and 
the relationships among them cannot, 
therefore, have changed, What has 


at coins on 
s alone are se Rhe 


college men, 
h Pathologists, and 
are just ph 'sicians, 

agram in Figure 
Ore or less at random. The 


Average = . 2 76 


the figure used so long as Р is located 
approximately in the center of A, B, С, 
апа D; and Puen is located at some dis- 
tance from EL 
In contrast to Table 19, Table 20 gives 
the correlations between the scales, based 
9n actual scores on the Vocational Inter- 
est Blank. When the four specialist 
groups are contrasted with Pmens the four 
scales correlate, on the average, -857 with 
басһ other, When the four specialist 
groups are contrasted with Pica the four 
scales correlate, on the average, .276 with 
€ach other, The lower correlations and 
hence better differentiation of the scales 
based on Pinea as compared to the scales 
based on Вв readily apparent. 
Maximum differentiation is obtained 
by contrasting 8roups with а point ol 
reference which is located in the center 
of the groups, ду the point of reference 
is located farther апа farther away from 


the groups, the differentiation becomes 
less and less, 


TrcunicaL Note B 


DEVELOPMENT OF THE MEDICAL SPECIALIST SCALES 


о 
1. Introduction 


Tus Technical Note explains the pro- 
cedures used in developing the in- 
terest scales recommended in this report. 
In order to understand these procedures 
it will be necessary for the reader to keep 
clearly in mind the following four types 
of scales: 


Гуре of scale Based on differences between 


A Criterion group and P,,, (men in 
general) reference group 

ho Criterion group and P,,4, (physi- 
cians in general) reference group 

BS Criterion group and Pimes, modified 
by differences among specialist 
groups. 

с Each pair of specialist groups meas- 


ured directly. 


Using scales based on the Vocational 
Interest Blank only, it is demonstrated in 
Technical Note A that scales based on 
Paca have much lower intercorrelations 
than scales based on Рм. The type A 
scales for the medical specialists will, 
therefore, not be considered further in 
this section. 


2. Evaluation of the BO Scales 


_ The primary function of the BO scales 
15 to differentiate each specialist group 
from Pas This was accomplished very 
Well when both blanks were utilized. 
Table 21 indicates that the average over- 
lapping is only 39 per cent between spe- 
Clalist groups and Р with a correspond- 
Ing biserial r of .81. 

It is also essential to the effectiveness 
ОГ these scales that they differentiate 
among the four groups of specialists. If 
Psychiatrists, for example, have nearly as 
high Scores on the Internist Scale as the 
internists do, guidance based on such a 
Scale is likely to be quite faulty. Actually, 
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differentiation between pairs of special- 
ists is excellent in 7 of the 12 compari- 
sons with an average overlap of 4o per 
cent (range 27 to 49). On 3 other com- 
parisons the overlapping ranges from 59 
to 64 per cent, which is still fairly good 
differentiation. But in ? comparisons the 
overlapping is 76 and 85 per cent re- 
spectively, which represents too small 
differentiation to be of practical value. 

The poorest differentiation involves in- 
ternists in contrast to psychiatrists and 
pathologists. It is poorest between these 
groups on the Internist Scale. 

In order to obtain some estimate of 
what differentiation was possible between 
pairs of specialists, the C scales were con- 
struc'td. For this purpose each specialist 
ro Was directly contrasted with each 
of the others. The percentage of overlap- 
ping between the groups of specialists on 
these C scales is indicated in Table 22.1 
These data warrant the expectation that 
better differentiation can be obtained 
than resulted from the BO scales and, 
furthermore, that internists can be dif- 
ferentiated nearly as well as the other 
three specialists. 


3. Weighting of Part Scores on BO Scales 


Attempts to improve the BO scales 
proceeded along two different lines. The 
first attempt involved weighting parts of 
the blanks so as to give maximum differ- 
entiation. The second attempt involved 
selecting items to accomplish this pur- 


pose. 
The problem of differentiating quali- 


‘It is recognized that the amount of over- 
lapping may be spuriously low. In this situation 
the actual amount is not as important as the 
fact that the internists are differentiated rela- 
tively as well as the other groups. 
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TABLE 21 


DIFFERENTIATION ОЕ BO AND BS Scares 
(7 = тоо for each group) : 


BO Scales BS Scales 
"erla 
Scal Groups Per Cent of Overlap ne Per Cent of Overlap £e 
e Compared Both 7 РВ Both anks 
th VIB MS ! | Blan 
Los po dd. Blanks Only Only  Blanks 
+73 
Г 5 7 54 48 3 
Internist Paca vs. I 52 52 49 71 57 Я 7 
Surgeon Pasa уз. S 46 39 34 E 52 ES E .83 
Pathologist | Pai vs. Ра | 44 46 37 p a 29 41 ‚бо 
Psychiatrist | Pmea vs. Ps 40 47 3 +83 x: 
+7 
Average 45 46 39 .81 49 50 42 _ 
9° 
i 3-4 62 37 45 “75 53 3o 31 186 
Internist I Ns ЕЯ 85 ЕА 76 :43 74 бт бт 5 38 
\ I vs. Ps 99 72 85 -23 75 55 60 
: 95 
Surgeon S vs. I 55 30 33 .88 40 31 24 E 
S vs. Pa 67 48 47 25 5I 40 E 109 
S уз. Ps бі 21 27 -93 38 25 1 = 
Rea 7 à .66 
Pathologist | Pa ys, I 71 64 +53 59 61 53 176 
а vs. 5 53 44 27 48 54 11 179 
Ра уз. Ps 74 бо -59 53 5o 4 
-63 
Psychiatrist Ps vs, I 64 59 +59 60 62 57 8 
y А .83 
Ps vs. S 49 35 .86 5o 36 3 75 
Ps vs. Pa 56 49 ey 52 47 46 ii „ 
A 66 z. 6 2 17 
verage 49 52 -67 54 4! 4 
VIB =Vocational 


Interest Blank 

MSPB = Medical Specialists Preference Blank 

bia — Biserial correlation Coefficient 

шей =Physicians-in-general Teference group 
I=Internists 
urgeons 
athologists 
Sychiatrists 


B 
Ps= 


for the computation of this statistic con- 

sist of intercorrelations of the variables 

being measured and estimates of the ef 

fectiveness of each variable in differ- 

entiating between each two classes. The 
TABLE 22 

DIFFERENTIATION OF C Type SCALES 


N=100 for each group) 
Scale 


Groups Compared 
Internist-Sur, eon 


1 Interni; E 
nternist-Pat ologist nternis rs ўш 
nternist-Psychiatrist nternist ys, 
urgeon-Pathologist urgeon vs, Pa hologist 
urgeon-Psychiatrist urgeon уз, Psychiatri 
athologist-Psychiatrist 


Percentage of Overlapping 
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computational procedures involved in 
determining the weights to be applied to 
the variables for maximum differentia- 
tion between two classes are Telatively 
simple. For more than two classes the 
computations become very complex. 

Intercorrelations between the 14 parts 
of the two blanks on each of the four 
scales were computed. Means and stand- 
ard deviations for each of the four groups 
of specialists were computed on each of 
the 14 parts on each of the four scales. 
Punched card machine methods were 
used in making these computations. 

A number of solutions using the dis- 
criminant function method were worked 
out between successive pairs of specialties. 
The effectiveness of using the resulting 
part-score weights was evaluated by 
estimating the percentage of overlapping 
between the various classes. 

Some improvement in the discrimina- 
tion between certain groups of specialists 
could be accomplished by the use of 
weighted part scores. However, such im- 
provement required a great reduction in 
the number of part scores being weighted 
and poorer differentiation among other 
Broups. 

It became apparent that these part 
Scores were not measuring separate vari- 
ables in the sense of being fairly homo- 
geneous and somewhat independent. The 
use of differential weights for the several 
part scores of the two blanks did not ap- 
pear to be the best method of improving 
the effectiveness of the scales. 


4- Selection of Items for BS Scales 


It became obvious that occupational 
items, for example, do not measure a dif- 
ferent interest from amusement items. 
Actually, one combination of occupations 
and amusements is liked by internists, 
another combination by surgeons, and so 


on. The second attempt to improve the 
scales viewed each item as a separate test, 
just as parts of a battery are viewed as 
separate tests. As it was impossible to 
handle 571 items as one does ten or 
fifteen tests in a battery, some other ap- 
proach than Fisher's discriminant func- 
tion had to be devised. 

The procedure followed in selecting 
items for the revised BO scales, called 
BS scales, is illustrated in Table 23. 
where four items are considered in de- 
tail. For each of the four items the per- 
centages of like, indifferent, and dislike 
responses to the item by Pmea and each 
of the four specialists groups are given. 
The weights assigned the item are ob- 
tained directly from a table which gives 
every possible combination of o to 100 
per cent. Thus, in the case of item No. 
4, the percentage of 16 for liking by in- 
terr^X Tf contrasted with the percentage 
of 21 уша and the table gives a weight 
of o. Similarly the percentage of 23 for 
indifference by internists is contrasted 
with the percentage of 30 by Pinea and the 
table gives a weight of 1. Since fewer in- 
ternists are indifferent to the item than 
Pmea the negative sign is attached, so that 
the weight reads —1. In the same man- 
ner a +1 weight is assigned dislike since 
61 per cent of internists dislike the item 
in contrast to 49 per cent of Р. Only 
zero weights are obtained from the table 
when the responses of surgeons, patholo- 
gists, and psychiatrists are contrasted 
with the responses of P mea- 

This procedure was used in weighting 
items for the BO scales. In this case item 
No. 4 is used on the Internist Scale, but 
not on the other three BO scales. The 
weights assigned to differences in per- 
centages of responses are based on Kel- 
leys formula in which the correlation 
between responses determines in large 


40 


E. K. STRONG, JR., AND A. c. TUCKER 


TABLE 23 
У F CALES 
ILLUSTRATING THE SELECTION OF ITEMS FOR BS S : í— 
Percentage Weights d Score оп m 
H а 
í is- ; Indif- Dis. | е 
oe Sate Like m [^ Like ferent like =e 
I Scale 
19 
B 21 30 49 = 38 
i med 2s 23 as o 1 1 эл 
Vo. S 16 30 54 17 
ai: Pa 19 32 49 19 _ 
Р5 23 29 48 к TT 
I, S Pa 
& Ps scade 
Scales se 
z6 39 
7 ә 
A Poss Ба i: 1 2 - —1i 110 259 
Мол 5 M 59 7 2 —1 —1 113 a 
Р; s 21 4 2 —1 "—À 125 126 
Ps E 18 5 2 p = 131 TN 
| B = T, H3. 
| Ps Scales 
11 
Prea 36 2 28 
No. 6 H 45 1 o 1 2s 
37 a. 6 
Pa 48 1 о 1 3 | 
Ps 48 1 о =й | 34 Е 
mm S Scale 
Pra 28 an 
No. 17 I 22 | =" o E 3 f 
S 36 | I o 24 
Ра 28 | б 
Ps | 28 | 23, 
hysicians-in-general reference group Pa = Pathologists 
Lernists 


With item N 
the item was u 
Weights of 2, — 
responses of liki 
liking, respectiy 
Seon, and Psy, 


of 2 


eight (4, 5). 

0. 10 ме have д case where 
all four BO scales. 
1, and —1 were assigned 
ng, indifference, and dis- 


ely, on the Internist, Sur- 
chiatrist Sc. 


sed on 


Ps 7 Psychiatrists 


man’s score on the 
Р, + Wi Ryt etc. 
weight and R 
(viz., “1” 
"o" if he does no 
totals for al] the it 
Man’s тауу Score, S, 
exactly that empl 
man’s blank on the 

Similarly, the n 


Оп a single item is 


14 are indifferent, 


V. 
item is W, R, + Ws 
where W equals the 


Жо se 
equals the man’s respon d 
А п 
if he marks that response, a 


h 

t). The sum of н 
- TEN 
€ms in the test is t 


re is 
o far the procedure 


А е 
Oyed in scoring th 
Scale. 


rsons 
aean score of n perso 


» И 80 physicians like “surgeon, 


and 6 dislike the 


| 
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activity and the weights are, respectively, 
4, —1 and —4, then the mean score on 
the item is 


1/100 [ (4 X 80) + (-1x ay + (=4 X 
6)] or 2.82. 


The sum of such totals for all the items 
in the test is the mean raw score of the 
group. 

By this procedure the mean score of a 
Stroup can be obtained without scoring 
the individual blanks on the appropriate 
Scale. All that is needed are the weights 
for the different responses to each item 
and the tally of responses of the group 
(6). 

The d score is the total, not mean, 
Score of тоо persons on a single item. In 
the above example it would be 282, not 
2.82. Such d scores indicate the contribu- 
tion of each item for each of the four 
specialist groups on each of the four 
scales. Table 23 shows the contribution of 
item No, 4 on the Internist Scale to be 38 
for internists, 24 for surgeons, 19 each 
for Paea and psychiatrists, and 17 for 
pathologists. This is a poor item, ap- 
proaching the lower limit of acceptabil- 
ity. 

Three standards were set up in terms 
ОЁ which items on the BO scales were 
accepted for the BS scales. First, an item 
Was rejected if higher d scores were ob- 
tained by any specialty group than the 
group for which the scale was designed. 
Second, an item was retained only if its 
d score was greater by 6 or more than 
the average of the d scores on the other 
three scales. It is not necessary to consider 
the Ps d scores since such scores cannot 
exceed the d scores for a group on its own 
Scale, so long as the weights are properly 
assigned. Since the revision was under- 
taken to increase the differentiation be- 
tween internists and psychiatrists, and 


between internists and pathologists— 
particularly with the Internist Scale—a 
third standard was maintained, namely, 
to accept items that discriminated in 
these directions even if they did not dis- 
criminate between internists and sur- 
geons. 

Consider now the application of these 
three standards to item No. 10 in Table 
23. The weights for Internist, Surgeon, 
and Psychiatrist BO Scales are 2, — 1, and 
The psychiatrist d score is 131, 
which is higher than the d scores for the 
other groups and also the 131 exceeds 
the average of the other three d scores, 
i.e., 115, by 16. The item is accepted for 
the Psychiatrist Scale and rejected for the 
Internist and Surgeon Scales. The weight- 
ing is different for the Pathologist Scale, 
but pathologists have a lower d score 
than pëichiatrists on that weighting; con- 
зеде ' the item is rejected for the 

ist Scale. 


-g 


Рае о; 

As far as the first two standards go, 
item No. 6 should be used in the Patholo- 
gist Scale since the pathologists have a 
higher d score than the other three 
groups and its d score is more than six 
greater than the average of the other 
three d scores. But it discriminated very 
little between internists and either pa- 
thologists or psychiatrists where greater 
discrimination was desired, while it dis- 
criminated considerably between ра- 
thologists and surgeons where the dis- 
crimination was already ample. The item 
was accordingly rejected. 

Item No. 17 is an example of an 
item that can be used successfully on two 
different scales. This is because the 
weights are reversed on the Internist and 
Surgeon Scales. The item contributes 
very little to the Internist Scale, barely 
meeting our requirements, but it makes a 
good contribution to the Surgeon Scale. 
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TABLE 24 


7 d STERNIS] ALES 
DIFFERENTIATION oF INTERNISTS FROM OTHER GROUPS ox THREE INTERNIST SCA 
(Vocational Interest Blank Only) 


; Per Cent Overlapping 
І, (BS) Scale Is Scale І, Scale with Internists 
Group I m 
Raw a b 

i SD = SD Mean SD Scale Scale | Scale 

Internist 73,5 8.92] 6.7 7.3 22.86 | 12.94 — Ex 788 
urgeon I.I2 10.84 1.8 6.6 19.4 10.7 53 2 —96* 
Pat! ologist 6.91 11.04 | 4.16 7.0 24.06 11.68 74 —8s 
Psychiatrist 7-14 10.94 | 7.78 6.18 27.36 11.48 75 =“ 69 

Pii 1.62 11.82 | —.96 7.74 9.52 12.36 57 I 


* Minus sign indicates the group scores higher than internists, 
i е. 


In Scale =65 items selected for BS Internist Scal 
1 | 


It might be pointed out that negative 
d scores are as useful as positivi 
provided the 
quirements, 


€ d scores 
Y meet the two standard те- 


above 


tional Interest Blank. There Ж 182 
items оп the Internist BO Scale on the 
Vocational Interest Blank, Only 65 were 
selected for the BS Scale, OF the re. 
mainder, 21 į 


the standards 


арріпр is in the Wrong 
that Psychiatrists score 


А ; i -nist 
higher than Internists on the Internis 
Scale. 


5. Evaluation of the BS Scales 


Comparisons of the effectiveness of 
the various BO and BS scales are given 
in Table 21. When both blanks are used, 
the average Overlapping of specialist 
Stoups with one another is decreased 
from 52 to 48 per cent, which represents 
an increase in the average biscrial correla- 
tion from .67 to -77- The poorest differ- 
entiation, represented by an overlap of 
61 per cent and an Ty, of .56, is still 
fairly good, 

It may help to understand these results 
to note that physicians and engineers 
Overlap 49 per cent on the Engineer 
Scale on the Vocational Interest Blank. 
The medical Specialist scales differentiate, 
on the average, опе Specialist group from 
another and from Р.а to the same de- 
Sree that physicians are differentiated 
from engineers, 

The BS scales are а real improvement 
from the standpoint of validity, especially 
in differentiating internists from psychi- 
atrists and Pathologists. But they contain 


* See footnote 1, Technical Note B. 
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far fewer items and, presumably as a re- 
sult, they have lower reliability. 

If the number of items is plotted 
against the reliability, two things are 
evident. First, there is an almost direct 
relationship between the number of 
items and the odd-even estimates of re- 
liability, if data from the BO and BS 
scales are considered separately. Second, 
the BS scales achieve a higher reliability 
per number of items used than do the 
BO scales. Approximately зоо items are 
needed for a reliability of .89 on the BO 
Scales in contrast to 225 items on the 
BS scales. Evidently, the selected items 
have higher reliability than the rejected 
items. 

The subject of reliability is discussed 
in detail in Technical Note F. It was de- 
cided to use the BS scales rather than the 
BO scales on the ground that validity is 
more important than reliability. 


6. Limitations of Selected-Item 
Procedure 


Where the objective is to differentiate 
subgroups from the total and at the same 
time subgroups from one another, the 
Selected-item procedure is superior to the 
usual method of selecting interest items. 
The procedure has been successful when 
four medical specialist subgroups have 
been contrasted. It seems at this time that 
Such a procedure could not be employed 
if as many as ten subgroups were to be 
So differentiated. Theoretically it could 
be done, as far as we know; but from 
the practical point of view, it is very 
doubtful. 

With the selected-item procedure, an 
item involving two possible responses, 
Such as the forced-choice items of the 
Medical Specialists Preference Blank, can 
be used on only two scales; and an item 
involving three possible responses can 


be used on only three scales. On the typi- 
cal like-indifferent-dislike item, weights 
such as —1, 1,0; —2,0,2; and 1, —1, —1 
could be used on three different scales. 
If all the 571 items on both blanks were 
used to theoretical capacity, this would 
mean that the average item would be 
used on 2.79 scales. But actually the 
items were used, on the average, on only 
1.13 scales. 

Assuming that 225 items are needed 
to give a reliability of .89, it means that 
199 items are actually needed per scale, 
as each item is used on 1.13 scales. For 
four scales 796 items would be needed, 
225 more than on the present two blanks. 
For 10 scales 1990 items would be neces- 
sary, which would require 1419 new 
items. 

It is doubtful if 1419 additional good 
items. d be found without great diffi- 
cule of course, to be expected that 
some" the items not used on the present 
four scales would be used on the six new 
scales and some of the present items 
not used to capacity could also be used 
more fully. Nevertheless, the number of 
new items necessary for ten scales presents ` 
an almost impossible task. Another ob- 
jection to using a test of 1990 items is 
that very few would voluntarily fill out 
such a blank, so that it would be difficult 
to obtain the necessary data from crite- 
rion groups to develop the scales. 

A more feasible procedure would be to 
determine the relationship of the other 
medical specialist groups to the present 
scales. It is likely that a number of spe- 
cialist groups will be found closely allied 
to one of these four groups. Thus, urol- 
ogists and orthopedic surgeons tend to 
score like surgeons and not like internists, 
pathologists, or psychiatrists. The present 
scales may thus be shown to predict inter- 
est in the four specialties and also in a 
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considerable number 
specialties. 

Once it is established that cer 
cialists are primaril 
distinct 


- е йй £ 
of the remaining point of reference composed entirely 0 


surgeons. Medical students could be 
scored on the present four BS scales plus 
additional scales which would indicate 
whether their interests were, for example, 
like surgeons, or like urologists, ortho- 
pedic surgeons, or neurological surgeons. 


tain spe- 
y like surgeons as 
from internists, pathologists, 
and psychiatrists, it might be possible to 
establish scales for these s 


pecialist groups, 
not in terms of P 


mea but in terms of a 


f. 


hb 


'TEcHNICAL Note C 


THE SPECIALIZATION LEVEL SCALE (5) 


By Milton G. Holmen, Ph.D. 


Te Specialization Level Scale was 
constructed to help the young doctor 
answer the question, "Should I special- 
ize?” The first step in developing this 
scale was to average the responses of the 
four specialist groups (internists, pathol- 
ogists, psychiatrists, and surgeons) to each 
possible response on the Vocational In- 
terest Blank and the Medical Specialists 
Preference Blank. The responses of each 
specialist group were given equal weight 
їп computing the averages used as the 
responses of the medical specialist group. 
Then the responses of the specialists were 
compared with those of the Pmea (physi- 
Clans in general) reference group. 
Weights were assigned as described in 
Technical Note B for the BO scales. 
The four specialist groups differ some- 
what from each other. It was believed 
that averaging the responses of the four 
groups would eliminate any group pe- 
culiarities. It was thought, also, that sub- 
tracting the responses of physicians in 


TABLE 25 
ILLUSTRATION OF METHOD OF DETERMINING 


WEIGHTS FOR AN ITEM ON THE SPECIAL- 
IZATION LEVEL SCALE 


‚ Per Cent Responding 


4 HE [жыл 
Groups Like Ino. Dislike 

Surgeons 65 28 7 
nternists 5o 35 15 
Psychiatrists 55. 29 16 
Pathologists 82 16 2 
Mean of Specialists 63 27 Xe 
Physicians in General 51 36 13 
Difference ` 12 —9 -3 
Weight assigned I —1 o 


T——————————— 


general from the averages of the four spe- 
cialist groups would.eliminate medical 
interests as such from the scale and leave 
only the interests of specialists. These in- 
terests of specialists should, thus, be rela- 
tively independent of the field of speciali- 
zation. 

A Specialization Level Scale was de- 

veloped for each of the two blanks by 
performing the computations illustrated 
in Table 25, for each of the items on the 
Vocational Interest Blank and the Medi- 
cal Specialists Preference Blank. The 
Specialization Level Scale on the Voca- 
tional Interest blank contains 240 weights 
ems. The scale on the Medical 
Preference Blank has 94 
\ 71 items. 
. Feliability (split-half corrected by 
the Spearman-Brown formula) of the 
scale using both blanks is .79. The Vo- 
cational Interest Blank part of the scale 
has a reliability of .77, and the Medical 
Specialists Preference Blank part of it has 
a reliability of .47. The blanks used for 
obtaining this reliability were those of 
100 physicians in general. A test-retest 
procedure would have been preferable 
as an estimate of reliability, but the prac- 
tical problems involved in getting test- 
retest scores on this group more than 
offset the advantages to be obtained by 
their use. The reliability of only .47 for 
the Medical Specialists Preference Blank 
part of the scale obviously precludes use 
of this blank by itself. The reliabilities 
of .77 and .79 are lower than one might 
desire, but not so low as to preclude use 
of the scale, if this fact is kept in mind 
when interpreting the scores. 

In developing norms for the scale, the 
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TABLE 26 . 
si c с ECIALIZATION LEVEL SCALE 
STATISTICAL CHARACTERISTICS OF DISTRIBUTIONS OF SCORES ON THE SrEciaLIZ 
tional Interest | Medical Specialists Both Blanks 
Group and Measure кы "Blank Preference Blank E 
Medical Specialists a 
Mean se 55 22 
SD o ME 
Physicians in general - 
Mean 38.33 43 36 ae 
SD 10.20 9.65 — 
| 
Difference between means | 
Mean difference 11.67 6.64 5 97 
SD of Diff. between Means 1.14 1.09 ms 
Critical Ratio of Diff, 10.24 6.09 9 TT 


Correlation between Scores on the two blanks —.47 


blanks of 100 specialists in each of the 
four fields were Scored on the scale. The 
Scores of this group (N — 400) were then 
transmuted into standard Score so that 
the distribution had a mean of.2 
Standard deviation of 10. 
The standard scores on the 5 
tion Level Scale were then obtain. 
the blanks of 100 physicians in ge 
These scores were compared with 
of the specialists, Th 
termine the significance of the diffe 
between the two distributions wa 
Critical ratio obtained by dividin 
difference between the me 


from 


neral. 
those 
€ test used to de. 
rence 
s the 
g the 
ans by the 


standard error of that difference, Table 
26 presents these means, standard errors, 
and critical ratios. These data clearly 1п- 
dicate that the two groups are separated 
by the use of each blank separately and 
by the two blanks combined. 

A more practical measure of the useful- 
ness of this scale is how well it actually 
classifies members of various groups into 
the categories of “A,” "B," etc. The dis 
tributions of the four groups of special- 


ists and of three other medical groups 
are shown in Table o» 


27. 
Research on the Vocational Interest 


Blank section of the Specialization Level 


TABLE 2; 


ATION LEVEL SCALE 


Per Cent Obtainin ; = TN І 
iin u be g Each Rating Е pesene 
ыт с. А B+ B B- | AE 
Internists 6 
Pathologists 68 A 8 3 2 
Psychiatrists 86 8 4 i т 
Surgeons 52 24 то з 2 
Medical Specialists | ke | fe m E E | nac 
hysicians in General* 28 19 д : 18 
Medical School Seniors 37 2s rs E: ы 
Агту Соттапа and Staff * ii 9 
Medical Officers | 37 22 16 13 i 
m ee Physicians in general were used in constructing the Scale, 


"ange of less than опе Standard score would be ре кй ratin; 


т wever, 
5S are probably spuriously low. Howe 


another similar sample (5, p. 647). 


-— 
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Scale has yielded some interesting find- 
ings. Within three nonmedical subject- 
matter areas (social science, physical sci- 
ence, and accounting), occupational 
groups are ranked in the same order by 
their mean specialization-level score as by 
their mean educational-level. This may 
be taken to indicate that the scale meas- 
ures liking for advanced education. To 
test whether this relationship would hold 
where the education was not of a special- 
ized nature, scores of two groups of grad- 
uate students in business administration 
were obtained. These students had been 
enrolled in the Stanford Graduate School 
Of Business working for the degree of 
Master of Business Administration. Half 
of them received this degree, and the 
other half dropped out or failed before 


completing the requirements for it. The 
Specialization Level Scale does not sep- 
arate these two groups. 

The Specialization Level Scale does 
separate chemists with Ph.D. degrees 
from those having M.S. degrees and those 
having B.S. degrees. The separation of 
chemists with M.S. degrees from those 
with B.S. degrees is not at a significant 
level (CR of .81), but is in the expected 
direction. Since advanced training in 
chemistry is highly specialized, and that 
in the Graduate School of Business is in- 
tended to be broadening, we may tenta- 
tively accept the hypothesis that what 
the scale measures is willingness to nar- 
row one’s vocational activities, as re- 
quired of a specialist, rather than mere 
tolerance for advanced education. 


TECHNICAL 


Note D 


PHYSICIAN AND PSYCHIATRIST SCALES ON THE 
_ VOCATIONAL INTEREST “BLANK 


HE guidance of college men and po- 
"Ero college men has been assisted 
by the many interest scales of the Voca- 
tional Interest Blank for Men. These 
Scales are based on the Ршеһ (men in 
general) reference group which is repre- 
sentative of men in occupations normal- 
ly entered by men with a college educa- 
tion and is thus not representative of 
all men. 

This Technical Note discusses two 
scales for the Vocational Interest Blank, 
There has been a Physician Scale for 
many years which has helped answer the 
question, "Should I be a physician?” 
This scale has been revised as p., * of this 
research project, The origin 51 
vised physician scales are com 

The possible need for a pe, 
scale in addition to the physici 
for use with college students w 
be discussed, As com 
general, are the in 
substantially differ 
average physician? 


‹ Scale 
ill also 
Pared to men in 
terests of psychiatrists 
ent from those of the 


1. Revision of Physician Scale 
The revised Physician scale for the 
Vocational Interest Blan 
Diod (physicians 


the origina] and revised 


ate .85. In the revision of 98 
other occupational scales, 


correlation between the original and y 
vised scales was :93. In only two of the 2 
revisions did the correlations fall below 
85, namely, .83 and .81. Revision -— 
28 scales involved an increase in size о 
the criterion group, on the average, О 
54 cases (from 200 to 264 cases) and in 
most cases involved a revision of es 
men-in-general group as the point of ret- 
erence. Revision of the physician scale 
involved an increase in size of the cri- 
terion group of 125 cases (from 377 i 
500 cases) but no change in point of reb- 
erence. In terms of these factors one 
would not expect as low a correlation as 
-85 between the original and revised phy- 
Sician scales. There was one other factor 
which may have contributed appreciably 
to this low correlation, The original pe 
was based very largely on graduates O 
Stanford Medical School, whereas the g^ 
vised scale is based on graduates of al 
the medical schools in the country. 4 
One measure of the goodness of an 1n- 
terest scale is the ratio of raw mean score 
divided by the raw standard deviation. 
On this basis the revised scale is greatly 
superior to the original scale—the ratios 
being, respectively, 2.72 and 1.84. If these 
ratios are multiplied by 10 and sub- 
tracted from 50, the result is the там 
Zero score expressed in standard scores) 
Le, 22.7 and 31.6. The chance score al- 
Ways approximates the raw zero score, bê- 
ing 21.7 for the revised scale and 29.7 
for the original scale. From the ait 
Point of chance there is less цен зоо, 
of obtaining a high score on the — 
scale than on the original scale. Bot 


Scales are about equally reliable (:873 
and 886), 


See —— 


эх 
AN 


. d 
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TABLE 28 


9RRELATIONS OF THE REVISED AND ORIGINAL 
PHYSICIANS SCALES WITH OTHER V QCATIONAL 
In :5т BLANK SCALES 

(N= 285 Stanford Seniors) 


Physician | Physician 


Scale Scale Scale 
(revised) | (original) 
Psychologist (rev.) -75 -58 
ysician (original) -85 — 
entist .83 .87 
Carpenter 2 
cersonnel 1 Manager — 24 - 25 
Office Worker —.54 —.72 
Occupational Level —.2 +03 
Tasculinity—Femininity 02 — .06 
Osteopath .8o .69 
Internist A .93 .8т 
эпгреоп A +95 .85 
Pathologist A .93 79 
Psychiatrist A +79 -54 


Correlations between scores on the 
original and revised Physician Scales with 
Scores on several other scales are given 
in Table 28. The four medical special- 
ist A scales? correlate substantially high- 
er with the revised scale than with the 
original scale (average .go and .75, re- 
Spectively), Aside from this difference, 


‘For definitions of A and BO type scales 
refer to Technical Note B. 


the corresponding correlation coefficients 
differ relatively little. 

It appears that the general relation- 
ships between the interests of physicians 
and other occupational groups as estab- 
lished by the original scale are main- 
tained to a large extent by the revised 
scale. Since the revised scale is based on 
a more recent and representative sample 
of physicians than was the original scale, 
it is recommended that this revised Phy- 
sician Scale be used in counseling college 
men. 


2. Need for a Psychiatrist Scale in 
Addition to a Physician Scale 
As measured by the Vocational Interest 


Blank, surgeons differ least of all in their 
interests from physicians in general, in- 


ternists Age second, pathologists third, 
and р trists fourth (see Table 29). 
Г iR а а 
'Thieir- nship holds whether differ- 
ences t°ekan scores or per cent of over- 


lappin™nre considered, and holds also on 
both A arid BO type scales. 

The same relationships hold when cor- 
relations are considered between each of 
the four specialist A scales and the re- 
vised Physician Scale. The Surgeon Scale 
correlates .95 with the Physician Scale, the 


TABLE 29 


COMPARISONS or MEDICAL SPECIALIST SCALES 
(Based on Vocational Interest Blank Only) 


Type of Scale Scale Groups Compared DI ference бе 
А Internist I vs. Bed 9.0 67 
Surgeon S vs. Pmed 6.5 75 
Pathologist Pa vs. Pmea 11.85 60 
Psychiatrist Ps vs. Ра 13.25 52 
BO Internist I vs. Paca 14.9 48 
Surgeon S vs. Роа 14.5 58 
Pathologist Ра vs. Ры 17.6 43 
Psychiatrist Ps vs. Pmea 18.2 35 


=Physicians in general, N =100. 
nternists, N =100. 

urgeons, N 
athologists, 
Sychiatrists, N= i. 


50 E. К. STRONG, JR., 


AND A. C. TUCKER 


TABLE 3o 


RorarED Factor LoapiNGs or VOCATIONAL I NTEREST BLANK SCALES 
(Factors II and III rotated 51° clockwise around I) 


i —— 
Factors L? 
з 1 I | m IV | 

2 37 
1. Psychologist (rev) 728 560 | 278 _ 126 tee 
2. Physician (original) 897 — 284 224 244 982 
3. Dentist 873 —304 —198 77298 934 
4. Carpenter 447 -123 | —811 28 oe 
5. Personnel Manager —310 | 793 ооо —07% gos 
6. Office Worker —595 | 287 | — 505 7018 851 
7. Occupational Level —087 T7499 | 815 E e 
8. Tasculinity-Femininity 142 —230 | — 350 188 b 
9- Osteopath 741 об | are — 584 % 
10. Internist А 925 260 199 —076 25: 
11. Surgeon A 953 109 098 | —268 5995 
12. Pathologist A 972 216 —054 159 a 
13. Psychiatrist A 708 639 127 ger ae 3 
14. Internist BO 127 506 695 | 190 796 
15. Ѕигреоп ВО 187 190 | 374 | 157 23 
16. Pathologist BO 754 256 | —038 420 812 
17. Psychiatrist BO —137 879 162 E 835 


Decimal points omitted, 


Internist Scale -93, the Patho}., 
:93, and the Psychiatrist Sca]; 
Correlations of :93 to .95 


€ 
Press perfect agreement, bu 
DO warrant for 


use of the Physici 
relation of . 


Psychiatrists raises the question 


based on the intercorrelations of scores 
ОП 17 scales. Included in the matrix were 
7 occupational Scales, the 4 medical spe 
cialist A type scales, the 4 nite 
cialist BO type scales, the Occupationa 
Level Scale, and the Masculinity-Fem- 
ininity Scale. The scores are based on the 
Vocational Interest Blank only. 


" ade 
Several Totations of factors were mad 


leading to the conclusion that the facto 
loadings as shown in Table 30 would 
be most useful. In this table the original 
factor loadings of Factors П and III were 
rotated біо Clockwise around Factor " 

The first factor may be named "medi- 
cal interest,” The scales and loadings €x- 
Pressive of this interest are: 


:972 Pathologist A 
:953 Surgeon A 

925 Internist A 

-897 Physician (old) 
-873 Dentist 

-754 Pathologist BO 
-741 Osteopath 

-728 Psychologist (rev.) 


ела ___ 
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-708 Psychiatrist A 
—.595 Office Worker 


Psychiatrists have a lower loading than 
any other medical group, even slightly 
lower than osteopaths and psychologists 
9n the A scales, They score lower than 
the other three specialist groups on the 
BO scales, 

Theoretically, medical interest should 
be eliminated in the BO scales since sim- 
ilarities in interests between physicians 
in general and the four specialist groups 
are ignored in the weighting of items. 
This holds true as shown by the drop in 
average loading for Factor I from .862 
on the A scales to .059 on the Internist, 
Surgeon, and Psychiatrist BO Scales, For 
Some unknown reason, the Pathologist 
BO Scale has the high loading of .754 in 
Factor I. 

The second factor may be named “іп- 
terest in people." The scales and load- 
ngs expressive of this interest are: 


‘879 Psychiatrist BO 


-793 Personnel Manager 
-659 Psychiatrist A 

-560 Psychologist (rev.) 
.506 Internist BO 


Psychiatrists score much higher than 
other medical groups on this factor, so 
that as far as this factor goes they are 
to be grouped with personnel men and 
psychologists rather than with medical 
men. No interpretation is made of Fac- 
tors III and IV. It appears that psychia- 
trists have less "medical interests" and 
more "interest in people" than the other 
three medical specialists and physicians 
in general. 

These results suggest that а Psychia- 
trist Scale, in addition to the Physicians 
Scale, might be useful in counseling col- 
lege men. ‘There are indications that the 
of physicians doing psychia- 
increasing substantially. It 
t a certain number of men 
shoulc \mter the medical schools whose 
Physicien Scale scores are only fair but 
whose Psychiatrist Scale scores are high. 


TECHNICAL Note E 


DEVELOPMENT OF THE 


MEDICAL SPECIALISTS 


PREFERENCE BLANK 


ХЕ of the first decisions made on this 
O project was to develop a blank spe- 
cifically for use by the medical profes- 
sion. All possible types of items that 
could be conceived of for this type of 
blank were freely discussed among the 
members of the project, A substantial 
number of conferences was held with 
interested members of the medical pro- 
fession, and the ideas of some physicians 
and psychologists were obtained by cor- 
respondence. 

One early decision was to emphasize 
the use of the "forced-choice" type of 
item which does not permit of an "indif- 
ferent" response. It was ber, >d that 
this type of item would be m i 
than the "Like-Indifferent- 


«cem 
in forcing fine discriminaties ‘mong 
quite similar professional grow: ' Later 


research by Zucker 
this belief (10). 
Another decision w. 


man did not support 


as to assign pri- 
the development 


working on the 
ert Е. Adamson, 
Ralph J. Garry, Milton С. Holmen, and 
man. The severa] types of 
items that were constructed will each be 
considered by indicating: (1) kind of 
item, (2) responsible assistant, (3) number 
of such items Constructed, (4) brief state- 
ment of rationale, and (5) sample item. 
1. Personal and Professiona] Relation- 
ships-Holmen-8o items. The several 
types of specialists would differ 
their expressed 
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sociate? (A) Conducts office in very busi- 
nesslike manner. (B) Conducts office in 
very friendly, informal manner. 

2, Medical and Premedical School Sub- 
Jects-Holmen-45 items. There would be 
stable differences among specialists as og 
liking or disliking certain subjects while 
in school. Sample item—Indicate whee 
you liked, were indifferent to, or disliked, 
Comparative Physiology, Cytology, etc- 

3- Casual Acquaintances and Dis 
Companions-Holmen-4o items, Special 
ists would tend to differ in preferring 
company of individuals in айшахан. one 
cupations. Sample items—On a а 
country train trip, would you like or п: 
like to make the acquaintance of si 
Banker, Artist, Reporter, etc.? At a large 
dinner party, would you like or dislike 
to be seated beside a woman who was 
à: Club Leader, Tennis Professional, Lt 
brarian, etc.? : 

4- Magazines-Holmen-20 items. There 
would be differences in preferences fot 
magazines. Sample item—Do, you like 
each of the following magazines: Life; 
Colliers, Readey's Digest, etc.? 

5. Amusements- Holmen — 20 items. 
There would be differences in prefer- 
ences for amusements, Sample item-In* 
dicate which of each of the following 
pairs of amusements you prefer; P lay 
Bridge or Play Poker; Western Movies 
or Whodunit Movies, etc, . 

б. Occupational Preferences-Zucker- 
mango: Чейз, Te iwas postulated that 
there are four modes of dealing with и 
environment, namely, analytic, visua^ 
Social, and manipulative, which are ae 
ured by descriptions of occupational ү 
Avocational activities, It was believed tha 


"i 
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the different. medical specialists would 
prefer different modes of 
Sample item—Indicate which of each pair 
of occupational activities you would pre- 
fer: (A) Interpret spoken passages for 
individuals who speak only foreign 
languages. (B) Install aerials for radio 
receiving sets; set up poles and attach the 
wires to them. 

7. Recreational Activities-Zuckerman 
~78 items. Essentially the same rationale 
as for the Occupational Preference items. 
Sample item—Indicate which of the ac- 
tivities you prefer: (A) Build а home- 
made radio set. (B) Look at a picture 
Magazine, 
| 8. Biographical Data – Adamson – 86 
items. It was believed that differences in 
background and early behavior would 
differentiate among the several types of 
Specialists. Sample item—In grade school, 
did you (A) Get into many fights? (B) 
Avoid fights by trying to "talk it over"? 
(C) Fight only when forced to? 

9. Type of Leadership-Garry-86 items. 

hree types of leadership were postu- 
lated which could be crudely labeled au- 
tocratic — (leader-centered), democratic 
(group-centered), and laissez-faire (indi- 
vidual-centered). It was believed that 
Surgeons would tend to prefer autocratic 
leadership, psychiatrists the democratic, 
and internists the laissez-faire. Sample 
item—Do you prefer the leader who: (A) 
Assumes that group members know rou- 
une procedures, or (B) Gives specific or- 
ders in routine tasks. 

, Experimental blanks containing these 
Items were administered to approximate- 
ly 300 Medical Corps officers at. Letter- 
man, Fitzsimons, and Brooke Army Hos- 
pitals. Included in this group were the 
Interns, and the resident and staff doctors 
of the Medical, Surgical, Neuropsychiat- 


behavior. 


8 


or 


ric, and Laboratory Services. Item counts 
were made of the responses of the various 
groups. 

The best items of these experimental 
blanks were selected for use in Form 
C of the Medical Specialists Preference 
Blank, which included 194 items. In se- 
lecting items for this blank, considera- 
tion was given to the ability to differ- 
entiate among the several groups of Army 
Medical Corps Officers. However, the 
selection was not done on a strictly ob- 
jective basis. 

Form C of the Medical Specialists 
Preference Blank was used in the mailing 
to the large civilian groups of Internists, 
Surgeons, Pathologists, and Psychiatrists, 
and to the physicians-in-general group 
selected by the American Medical Asso- 
ciation. I* 7m counts on these groups were 


the b Vor the development of the 
sca NS this research. 

Fox o, epresents a revision of this 
blank, ich retained all items that were 


weighteb. "yn the scales. The section on 
Types of Leadership was eliminated be- 
cause of generally poor differentiation 
and because of the large number of items 
not answered. In order to facilitate scor- 
ing, the four- and five-choice Biographi- 
cal Information items were restructured 
as three-choice items, This form contains 
171 items in the following parts: Profes- 
sional Associate-5o items; Biographical 
Data-24 items; Medical School Subjects 
-35 items; Traveling-15 items; Occupa- 
tions-27 items; and Activities-20 items. 

Form D was used in obtaining data 
on the following groups: medical school 
seniors, Army interns, Army Command 
and Staff medical officers, orthopedic sur- 
geons, urologists, neurological surgeons, 
and pediatricians. 


Trcunicat Nore Е 


CROSS VALIDATION 


НЕ true validity of the medical spe- 
Tar scales, that is, their ability to 
predict future behavior, can only be de- 
termined by follow-up studies extending 
over a period of several years, Arrange- 
ments have been made for such studies 
by collecting blanks from approximately 


item counts were made 
and these blanks constitute ;; 


of cross-validation data, The 
small, ranging in size от. 


ERION GROUPS anp SMALL 
ON THE MEDICAL SPEcTIAList ScaLEs 


AND RELIABILITY 
3 


"Table 31 compares the distributions of 
Scores on the blanks used in the item 
counts on which the scales were based 
with the scores on the blanks received 
later. No change is indicated on the In- 
ternist and Pathologist Scales and p 
changes on the other two scales are o 
doubtful significance, It appears that ih 
few blanks in the 30-84 standard seare 
range by the surgeons and psychiatrists 
may largely account for the changes in 
means on these scales. 

Another method of examining ilie 
cross-validation groups is to determine 
the percentage of overlap of the iri 
pairs of groups on the four medica 
specialist scales. Table 32 presents the re- 
sults of such an analysis. It is interesting 
that five out of the six comparisons 1n- 


1 


CRoss-VaLIDATION Скосрѕ 


Рег Cent of | Per Cent of Per Cent of Per Cent of 
nternists on urgeons on Pathologists on Psychiatrists an 
РИ nternist Scale urgeon Scale d Pathologist Scale Psychiatrist Sca 
core Item Item Item 2 
Count Extra Count Extra Count Extra dm. Te 
Tanks | Blanks | pount | рна ¿s | Blank Blanes 
А оез anks = 8 | Blanks 5 | Blanks =35 
=211 N=188* = =1оо* | N=24 N=167* en 
65+ 7.1 6.2 T » 
у ё > 4 Şa 6.0 8. 6.6 5-7 
60-64 10.0 8.8 9.6 5.2 10.0 A: ыр 2g 
55-59 14.7 20.0 17.0 10.3 16.0 29.2 18.0 14.4 
i5 17.1 18.8 21.3 20.7 21.0 12.5 22.2 22.8 
ср e 13.8 21.3 22.4 15.0 4.3 15.6 22.8 
oe Ex 16.2 14.3 15.5 16.0 20.8 11.4 In 
% -$ 8.8 53 5.2 10.0 8 $ $7 
30-34 1.9 1.2 2.7 13.8 4.0 oe р 8.6 
29— 2.4 6.2 Tur 1.5 2-5 3 нд 5.7 
4 - = = 
Total 
= 100%, 100%, 100%, 100%, 100% 100%, 100% 100% 
ean 49.70 49.40 50.85 5 
35 08 Se | su esee zs 
- j .25 * 
CR of Diff. Жай Ar | 1.54 
е —.35 ` 
* The item counts used in constructin, 
з ig the sca], i ei 
Sra at M ret te ILU PIT 


ical 
both the Vocational Interest Blank and the Medi 
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TABLE 32 


COMPARISONS OF THE OVERLAP OF CRITERION GROUPS AND SMALL Cross-VALIDATION GROUPS 
ON THE MEDICAL SPECIALIST SCALES 


Per Cent of Overlap 
Scale ys, 
^ Groups Compared Criterion Cross-Valida- 
"s Groups tion Groups* 
5 | 
Internist Internists vs. Surgeons. 31 42 
Internists vs. Pathologists 61 58 
Internists vs. Psychiatrists 6o 6o 
Surgeon Surgeons vs. Internists 24 37 
Surgeons vs. Pathologists 31 48 
г, Surgeons уз. Psychiatrists 18 3I 
Pathologist Pathologists vs. Internists 53 5I 
Pathologists vs.’ Surgeons | 44 46 
эы Pathologists vs. Psychiatrists 2 38 
Psychiatrist | Psychiatrists vs. Internists 57 62 
| Psychiatrists vs. Surgeons. 38 51 
та Psychiatrists vs. Pathologists 46 47 
Average 42% 48% 


* Size of cross-validation groups—Internists N = 80, Surgeons N =58, Pathologists № =24, Psychiatrists N =35. 


TABLE 33" 


ESTIMATES OF THE RELIABILIT: a ALES 
(Correlations of Odd-Evet 
№ = 100 Physicians in ЙК ^ 
= А ch ip = 
Vocational Interest Medical Specialists А 
Blank Preference Blank Both Blanks 
Scale Type 
Items Raw ico Items Raw El Items Raw Eu 
Internist BS 65 47 -64 зә -39 56 97 -52 69 
BO 182 .62 .76 96 .70 -83 278 :75 .86 
Surgeon BS 87 -58 -73 з 46 .63 | 138 — .65 — .78 
BO 184 „бо E 85 .46 -63 269 -65 .79 
Pathologist BS 116 .67 .8o 59 -85 л 175 -67 .8o 
BO 229 „72 .83 103 .47 ‚64 232 КУЛ .8s 
Psychiatrist BS 165 SN .87 7 Ed 71 236 .8o .89 


BO 250 225 .87 110 .64 .78 360 82 .9o 


Specialization 


Level BO 149 .62 -77 71 31 47 220 -65 -79 
Şurg—Int б ims .65 .79 102 -67 .8o 296 Nu .87 
Roe жЕ С 186 .7о .82 от -49 -65 277 -69 -82 
poch—Int C 230 7 ‚86 102 .20 +34 332 ‚бо .82 
path—Surg € 240 .68 ‚81 o5 +56 +72 335 +73 84 
poych—Surg { 253 “77 87 120 .68 81 373 ‚85 .92 
Psych—Path € 252 .75 .86 121 +52 -69 373 -79 .88 

Hems — -Number of i veighted on the scale. | жг 

Raw = Product. png HUE "between 8 on odd versus even items. 


Corrected = Raw corrected by Spearman-Brown formula. 
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volving surgeons show a marked increase 
in overlap while all the other compari- 
sons show little difference between the 
criterion and cross-validation groups. In 
fact, the six comparisons which do not 
involve Surgeons have the same average 
overlap in each group. It is not possible, 
at this time, to determine whether these 
results with the Surgeons are an arti- 
fact due to a few peculiar blanks in the 
small cross-validation group or because 
the Surgeon Scale is less stable than the 
others, 

The validity of scales, that is, how well 
the various scales differentiate between 
groups, has been emphasized in this re- 
search report, Another measure of the 
goodness of a scale is reliability. What 
is the reliability of the various scales? 

One estimate of reliability : 
lation between scores on 
bered items and scores on 
bered items on each scale 
reliability refers 


S , inter- 
Tee 39 re- 


BS scales, "These 


an average reliability 
ОЁ .7g1 and contain, on the average, 162 


items per scale, The corresponding ВО 
an average reliability of 850 


is a direct relationship, 

a, between reliability 
mber of items in the 
on in reliability from 
i attributed to 


BS scales as compared to BO scales. This 
is Particularly true with respect to the 
BS Internist Scale. 

Anothér measure of reliability, те 
ferred to as the coefficient of stability, 15 
based upon the correlation between 
and retest Scores, where the two wes 
are completed within a relatively ped 
period of time. Burnham reported ea 
coefficients for eight interest scales for a ‘ 
interval of one week (э). These eight en 
efficients averaged .906 in contrast to .8 | 
for coefficients based on odd-even ee 
parisons, It is likely that the enn 
of reliability given in Table gi are pd 
than they would be if based on test 
retest scores, Ж 

The size of а correlation coefficient S 
affected by the range of scores on ы: 
the computations are based. The бей 
cients in Table 83 are based on blanks 
from the physician-in-general group. It 
seemed appropriate to use this group 
since the BO and BS scales were de- 
signed to differentiate physicians. The 
physician-in-general group is, however, 
a relatively homogeneous group. p 

The issue is whether or not scales with 
poorer validity and better reliability 
should be preferred to scales with bet- 
ter validity and poorer reliability (see 
Tables 21 and 33). BS scales have been 
selected over BO scales on the basis of 
Sreater validity. It js believed that valid- 
ity is more important than reliability» 
that validity automatically necessitates 
reliability, anq that the measures of in- 
ternal consistency in Table 38 are not 
complete measures of reliability. 7 

The answer to the above question 
must wait until there can be a follow- 
up of medical students which will ascer- 
tain the extent to which scores of medi- 
cal students on the two types of scales 
are related to subsequent medical careers: 


"E 


и" 
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APPENDIX 1 
CHARACTERISTICS OF SPECIALIST CRITERION GROUPS 
A. Age In Years 
. | Physi- 
Item Intern- | Surgeons Pathol- | Psychi- | cians in 
ists ogists atrists General 
| 
Mean Range 36.9 38.4 40.5 39.3 40.0 
32-39 | 31-44 | 31-49 | 32-46 | 24—55 
B. Per Cent Residing in Each Geographical Area* 
Of All E 
Physi- | Intern- Pathol- Psychi- Less 
cians in| ists. |Surseons| ogists | atrists ene 
U.S. enera 
I. New England 7.9 7.6 9.8 8.4 
?. North Atlantic 29.6 26.8 39.9 30-4 
3. Midwest 28.1 26.8 2543 28.4 
4. South 15.3 16.8 9.2 14.5 
5. Southwest 5.8 6.2 349 z 
6. Mountain 2.3 2.6 2.4 2.3 
7. Pacific 11.0 13.2 10.3 10.0 
|. 
otal 100% 100% 100% | 100% 
C. Per Cent Graduates of Medical Schools Located 
In Each Geographical Area* 
. | Physi- 
Area Intern- Surgeons pus Pee cians in 
ists ogists atrists | General 
I. New England 10.7 15.5 10.8 36.8 8.0 
2. North Atlantic 31.1 32.1 36.6 36.6 3o.8 
3. Midwest 35-1 30.6 32.4 Бү 35.2 
4. South i3.t тт] 9.5 Түй 17.0 
5. Southwest 3.8 2-5 Te] 2.8 4.2 
6. Mountain 1.0 .6 1.5 Ту 8 
7. Pacific 5.2 6.2 7.5 4.6 4.0 
Total 100% 100% 100% 100% 100% 
*N > i hire, Vermont, Massachusetts, Rhode Island, Connecticut. 
Heth dire New Vork ее eae, Nay Jersey, Delaware, Maryland, District of Columbia. 
"Indiana, Wisconsin, Minnesota, Iowa, Missouri, North Dakota, South 


Midwest: Ohio, Michigan, Ind 
Dakota, Kansas, Nebraska, III 


inois. South: Virginia, West Virginia, Kentucky, Tennessee, North 
Carolina, South Carolina, Georgia, Florida, Alabama, Mississippi, Arkansas, Louisiana. Southwest: 
Texas, Oklahoma, New Mexico, Arizona. Mountain: Idaho, Montana, Wyoming, Nevada, Utah, 
Colorado. Pacific: Washington, Oregon, California. 
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REPORT OF MEDICAL INTERESTS 
[4 


Purpose 
The purpose of this report is to assist you in plan- 
ning your career. It is based on your responses on 
the Vocational Interest Blank for Men! and the Medi- 
cal Specialists Preference Blank. The Vocational In- 
terest Blank has been widely used for many years 
in assisting young men in making decisions regard- 
ing their vocational careers. The Medical Specialists 
Preference Blank has been developed Specifically for 

use by the medical profession, 


The extent to which your interests agree or dis- 
agree with those of successful men in certain types of 
work are indicated, Extensive research over the past 
twenty-five years shows that such measures have con- 
siderable accuracy in predicting whether one would 
like certain Occupations or not. Continuing high mo- 
tivation and job Satisfaction appear to be related to 
these measures of common interests, 


This is not a Teport of your aptitudes or abilities 
to do certain types of work. For exam * 
regarding your ability to get throuc™ 
or to learn to perform surgical ореб 
Swered by this report. 


questions 
“A school 


The measures ot the interests 
of the four major medical specialti у, 
veloped by the Medical Specialists hex... -d 
Stanford University.» 


T: Percent ot Percent of 
эш ЕКЫ edict Scoot 
A 71 73 
By 13 M 
B 8 8 
BH 5 4 
с 3 1 
Total 100% 100% 
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Explanation of Scores | А 
Four questions confront anyone considering medi- 
cine as a career. First, should one be a physician or 
engage in some other occupation? Second, if a physi- 
cian, should one specialize in one of the 32 recognized 
specialities to the extent of taking several years resi- 
dency training and passing the board examinations? 
Third, if one is to specialize, which specialty should 
one select? And fourth, what types of activities within 
the medical profession would one like to do? 


Test No. 1 answers the first question. Your inter- 
ests are compared with the interests of the average 
doctor and the score indicates whether your interests 
are more in agreement with the interests of the aver- 
age doctor or more in agreement with the average 
man engaged in those occupations which college a 
expect to enter, Table 1 gives the percentages О 
various groups who have ratings from A to C on the 
physician scale. If you have a B rating, for example. 
in physician interest it means that at least 84 percent 
of physicians have interests more akin to the average 
doctor than you do and at least 8 percent of physicians 
have interests less akin to the average doctor, than 
you do. Having a B— or C rating does not mean you 
cannot be a doctor, but that you probably wil? not 
enjoy treating patients and that there may be some 


other occupational activity which is more akin to your 
interests, 


1 Vocational Interest Blank for Men (revised) Form М by Ed 


ward К. Strong, Jr., Stanford University, 


* Medical Specialists Proferenco Blank, Form D (Research odi- 
Поп), by E. К. Song, Jr, A. c. Tucker, R, E, Adamson, М. 
Holmen, J. V, Zuc 3 


Percent of 


‹ Percent of 
College Sai In painoa assent 
n 1 
10 2 
13 4 
13 10 
53 83 
100% 100% 


һе 


^ 


| 


The second question is answered by Test No. 2, 
ie. do you have the interests of medical specialists 
or the interests of the average non-specialist doctor? 
About fifteen percent of physicians are today diplo- 
mates in some specialty. It is probable that this per- 
centage will be doubled in the next twenty years. 
You may or may not wish to go through the long 
specialized training perfecting yourself in a particu- 
lar specialty and may or may not desire to limit your 
practice as is required of a diplomate. 


The third question is partially answered by the 
four Tests 3, 4, 5 and 6. At the present time tests are 
available for only the four specialities of Internist, 
Surgeon, Pathologist, and Psychiatrist. How you score 
on these four specialties may also give some idea 
of how you might score on other specialties which 
are akin to these four. For example, the surgeon's 
Score should represent the areas of urology and or- 
thopedic surgery quite well. Similarly cardiology 
and dermatology appear closely related to internal 
medicine. 


А high score on one of the specialties coupled 
with a low score on Test 2 suggests that you will 
enjoy work in that activity but that you may not want 
to spend several years in rigorous preparation or to 
devote all your time to it. 


The four Tests 3, 4, 5 and 6 apply only to men who 
have the interests of doctors. These scores are mean- 
ingless if you rate C or B— on the physician scale 
апа questionable if you have a В rating. 


Some men score about equally high on two, or 
even three, of the four specialties. In such cases in- 
formation is given in No. 7 as to whether there is a 
real difference (yes), а probable difference, or the 
Scores are tied. 


The fourth question refers to types of work within 
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the medical profession which will be interesting to 
you. The scores for the ten occupational scales listed 
in No. 8 may be helpful. Among graduates of medi- 
cal schools some devote relatively little or no time to 
the treatment of patients, spending their time in a 
variety of activities, such as teaching, research, hos- 
pital administration, preventive medicine, marketing 
medical supplies, etc. 


Your scores in No. 8 may be interpreted in two 
ways. First, with reference to how men score who 
are engaged in these occupations. An A rating means 
"yes," you have the interests of men in that occu- 
pation. A rating of B+ means “probaoly,” etc. Such 
ratings are interpreted in the same way as your score 
in physician interest in No. 1. 


For some purposes it is well to consider how your 
interests compare, not with men engaged in the ten 
occupations, but with doctors alone. The shaded 
areas provide the basis for such interpretations of 
your scores. Twenty-five percent of physicians score 
above the shaded area, fifty percent score within the 
shaded area, and twenty-five percent below this 
area. For example, if your score on office worker 15 
а В, it means you possibly have the interests of office 
workers; but you have more of the interests of office 
workers than the great majority of physicians. Such 
a score s° ^l x that you may like administrative 


work, \ dislike И less than most doctors. 
Веа} 1 all administrators spend much of 
their | letters and report forms, the work 
of an о: Ji 


Simi?" ‘gh score on chemist may suggest 
research in “medicine involving chemistry. A high 
score on the public administrator scale might indicate 
work in a public medical activity in contrast to pri- 
vate practice. A high score on the life insurance 
salesman scale, not at all common among doctors, 
might suggest some sales activity related to medicine. 


Edward K. Strong, Jr., Ph.D. 
Professor of Applied Psychology 


Anthony C. Tucker, Ph.D. 
Colonel, Medical Service Corps, U.S. Army 
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Your Vocational Interest Blank 1 
be helpful to you. € 


a. Administratiy, 
Public Admini, 


Chemist 
© Persuasive 


Interests 
Life Insurance Sale: 
d. Linguistic Interests 
Author Journalist 
е. Aviation Interests 
Aviator е 


9. Comments, 
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A 


PREFACE 


What is the meaning of occupational level as measured by interest 
tests? Is having interests like those of executives a sign of motivation to 
strive to rise to high position? Or is occupational interest level simply 
an index of similarity of interests to those of men at various occupa- 
tional levels, devoid of dynamics and unrelated to drive? 

It is these questions which we have sought to answer in the studies 
and in the final synthesizing essay which constitute this monograph. 
Barnett and Handelsman were stimulated to test the validity of com- 
mon interpretations of the Occupational (Interest) Level scale of 
Strong's Vocational Interest Blank; Stewart was moved, by the lack 
of such research, to look into the nature of the relationship between 
adolescent experiences and interests; a ДӘ М riter had the pleasure 
of helping Barnett, Handelsman, ап Ë * 
conceived studies in relation to each ot organize their results 
into one systematic report. We are inde’ prs. Herbert S. Conrad 
and Edward K. Strong, Jr., for their h.*;: sad suggestions with the 
manuscript; the interpretations are our own. 

The results should be helpful to vocational counselors and personnel 
workers using tests in counseling and selection, They should be of 
value to students of developmental psychology and of motivation. They 
should stimulate further research in an important area of theory and 


practice. 


Teachers College, Columbia University 
January, 1951 
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Level of Occupational Interests: Measure 
` of Status or of Drive? 


yaoa interest has often been 
conceived of by educators, social 
workers, and psychologists as more or less 
synonymous with drive, the underlying 
assumption apparently being that if an 
individual likes an activity he will seek to 
engage in it and apply himself to it with 
às much effectiveness as his ability level 
Permits. When Strong’s analysis of the re- 
lationship between occupational interests 
and socioeconomic level (49: Ch. 10) 
showed that occupational interests can be 
arranged in a hierarchy according to so- 
cial level, justas occupations can be classi- 
fied according to intelligence, it seemed 
to many that the equivalence of interest 
and drive had been demonstrated and, 
furthermore, that Strong's scale for meas- 
uring occupational interest level pro- 
vided an instrument for the measurement 
of drive or aspiration level. 

This scale has been the subject of a 


Unemployment Satisfaction Scale 


Rating of Level of Aspiration 
Appendix D: Biographical Questionnaire 


ке ch Strong's Vocational Interest 
Blank. But the few published investiga- 
tions of the meaning of the Occupational 
Level scale have not, as will shortly be 
made clear, shown to what extent level 
of vocational interest is a driving force 
which motivates the individual to strive 
to attain a status compatible with his 
level of interest, or simply a reflection of 
socioeconomic level. Is having interests 
like those of professional men an index 
of motivation to strive to rise to the 
higher socioeconomic level? Are adoles- 
cents with interests like those of business 
executives inclined to show, in their 
school activities and in their educational 
and vocational goals, patterns of be- 
havior which can be interpreted as indi- 
cations of a high aspiration level? Are 
men whose level of vocational interests is 
high likely to be dissatisfied with a low 
level of accomplishment, while those with 


wor’ 
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low Occupational interest levels are satis- 
fied with unemployment, drifting, and 
dependency? Or is occupational interest 
level simply a measure of the extent to 
which an individual has, through cultural 
influences in or outside of the home, de- 
veloped interest in objects and activities 
which happen to characterize one or an- 
other of the various socioeconomic levels? 
Is it possible, in other words, that there is 
no drive or motivating force inherent in 
level of vocational interest? These are im- 


portant questions to the counselor and 
personnel worker. 


The Occupational Level (OL) Scale 


It has been demonstrated that occupa- 
tions may be arranged in a hierarchy 
according to the average intelligence of 
the people engaged in them (47\ Prior to 
the development of the OL f 
not known whether there exit 
lar rank order of Occupations * 
interests, and, provided there у 
er the two hierarchies меге sini, 

In order to investigate this problem, 
Strong Constructed the OL Scale, which 


Contrasts the interests of semiskilled la- 
borers with the inte 


of 
*th- 


mean OL scores from unskilled to semi- 
skilled to skilled Workers, and from there 
upward to business executives and profes- 
sional men. He concluded: 


Men cannot be assigned to a specific Ligne 
tion on the basis of intelligence. test. eer 
Neither can they be assigned to a specific pe 
pation in terms of an OL score. In both oA is 
there is far too great overlapping не 
occupations to make this possible, ——€— Si 
Such assignments can be made in a general Way 
men with high OL scores have the oen he 
business executives and professional men, of 
those with low Scores have the interests 
workmen (49, Р. 195). 


After extensive counseling experience 
with Strong's Blank, Darley drew the fol- 
lowing conclusions concerning the mean- 
ing of the OL scale: 


Occupational level, a quantitative statement 
of the eventual adult "level of aspiration, B 
resents the degree to which the indi 
total background has prepared him to seck es 
prestige and discharge the social responsibi ae 
growing out of high income, professional gua at 
recognition, or leadership in the community; ia 
the lower end of the scale the individual's ер 
ground has prepared him for the anonym! : 
the mundane round of activities, and the T 
lowership" status of a great majority of t 
Population (15, р. бо). 


Elsewhere Darley has concluded: 


Iam becoming clinically more convinced v 
that the occupational level score is an узуы ion 
quantitative statement of a form of mate 
or level of aspiration or some other dynam č 
Spect that is... referred to in the literatu! 
as “drive” (49, p. 465). 


Studies of the Meaning of the OL Scale 


There have been few attempts to ed 
vestigate the factor or factors measure¢ 
by the Or, Scale. Most of the prm 
knowledge js based on Strong's data ЕТ, 
lected in the development of the sc@ ix 
Other studies that have been made zw 
little agreement with respect to жаң 4 

Һеѕе аге referred to when relevant i 
the fina] Chapter of this monograph- 
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What Is the Significance of Occupational 
Interest Level? 


The three chapters immegiately fol- 
lowing describe three studies, each of 
them designed to investigate the nature 
of the factors measured by the OL scale. 
While all three studies were carried out 
under the sponsorship of one person, each 
represents an independent and distinctive 
approach to validation of the OL scale. 


While there is enough agreement among 
the findings to make possible some defi- 
nite conclusions, there are some discrep- 
ancies which still challenge the counselor 
and researcher. The final chapter con- 
siders the three studies, synthesizing the 
compatible conclusions of these and 
earlier investigations and attempting to 
ascertain logical grounds for the dissimi- 
larities. 


Cuaprer II 


LEVEL OF OCCUPATIONAL IN 


TEREST AND SATISFACTION 


WITH CHRONIC VAGRANCY* 


Gorpon J. 
Problem and Method 
F IT were discovered that, of a group 
I of subjects who had no jobs and had 
not had any job for much or their lives, 
those who were satisfied with being unem- 
Ployed earned low OL (occupational 


› 


Source of Data: Chronic Vagrants 


From a Broup of s» 


1 district of New York 
City, 763 men Were interviewed for bio- 
Staphical data and detailed Occupational 
histories, Selection was made at the rate 
of Approximately 1 applicant in к 


* Part of a Ph.D. investigation conducted at 
Teachers College, Columbia University, under 
the direction of T. Donald E. 
Laurance Shiffer, Dr. i 

Robert L, Thorndike, 


Barnett 


considered justified and to derive a sam- 
ple of real vagrants, 
| All the applicants who were ари 
for study were designated chronically is 
nonchronically unemployed, peer | 
to the following criterion. The total > С 
sible work life of each applicant was de 
termined by means of detailed {но 
ing. Total possible work life was wes 
Sidered to be the tota] time in ong 
that had elapsed since the applicant hac 
finished his forma] education and left е 
home (ог substitute therefor), An — 
of unemployment was computed for v^ 
applicant interviewed by dividing н 
total possible work life in months into 
total months Unemployed. If an appli 
cant had left school at the age of 14, 
his work life was considered to have bê- 
sun at that time; if he had шше 
master’s degree, and had been арта 
engaged in study up to the date the ¢ i 
Sree was granted, his work life was лан 
sidered to have begun with the awarding 
of the degree, Work done during АШ 
Vacations while the individual was е 
technically а Student was disregarded, 
regardless of Whether he had then Dp 
pleted the sixth grade or had earned а 
graduate degree, 3i 
When the applicant's index of ман 
ployment had been determined, he нея 
classified as ‘chronically or eager 80 
cally unemployed according to m 
his index Was more or less than 5n Р г 
whether he had been unemployed M 
More or Jess than half his possible “ee 
life, the former, of course, being 
chronics, All chronics were instructed 


ECC ш 


A 
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move to a small room adjoining the room 
In which they had been interviewed, 
Where, under conditions more suitable for 
the administration of psychological tests, 
they were administered the measuring 
devices described after the personal his- 
tory data in the following section. 


Factors Investigated 


f Аз each man was interviewed, this in- 
ormation was elicited: 


e den months. A person's age provides an in- 
Which A of his maturity and of the degree to 
Physiol = has been exposed to his culture. 
Nh ов]. and psychological changes occur 
one's Де which might be expected to modify 
зно titudes, In the case of the men under 
ably aes in this study, age might conceiv- 
E Dd either of two diametrically opposite 

5 оп attitude toward chronic unemploy- 
ie pc older men might be discovered to 
men p morc satisfied than the younger 
less JA the result of having become more or 
ships ids ta unemployment and the hard- 
ds yet herent in it, with the younger men not 
and ‘th accustomed to the rigors of such a life 
it PC generally less satisfied with it. Second, 
е be found that the younger men аге 
eae ly more satisfied, as a result of not yet 
вр come to grips with the multitude of 
Work ems that face anyone who is unwilling to 
disillusi our society, with the older men more 
prodiere more bitter, about such an un- 
Mene е and unrewarding existence, and 
A ey less satisfied with it. While the 
and d 15 one of the conservative. old man 
cottesi si radical young man, still it is es 
be Dun a that this latter. relationship might 
Posible. to exist. Therefore, as closely as was 
cant’s * with a group of this type, each appli- 

age was determined. 


tion, teational level. While there is great varia- 
in 


during 


of j 1 А 
education attained does provide some evi- 


den А d x 
sha ce of one's accomplishments. The relation- 
“Up th 


in whi 
fled w 


heir yy, 
cants 
Order 
educ; 


expressed dissatisfaction at times. In 
PS Check more thoroughly on this factor, 
“Поп in months, represented by the high- 


' 


est grade reached, was ascertained. 

Father's occupation. Occupation is one index 
of the degree of success attained in the working 
world. In this country, at least, occupation rep- 
resents a widely accepted criterion of success. 
The occupations of the applicants’ fathers 
(major occupations in the cases of fathers who 
had held more than one type of job) were used 
as an index of parental socioeconomic status in 
this study. It could be expected that applicants 
from "better homes" in terms of their fathers' 
occupations would be less satisfied with the life 
of the vagrant than those from homes in which 
the nominal head of the family had never risen 
above the level of the majority of people about 
him. In view of the frequent discrepant rela- 
tionships discussed above, however, father's occu- 
pation was included for study. 

Following the direct questioning, each man 
who met the above-mentioned criteria for desig- 
nation as a "chronic" vagrant was administered 
the written test materials, which covered these 
areas: 

Intelligence. Scores on verbal intelligence 
tests provide reasonably valid indicators of ca- 
pacity fo~ abstract thought. Level of intelligence 

р £ ted to influence attitudes; in the 
Vie toward being chronically un- 
ould seem that the most logical 
ould be one in which the more 
"n are least satisfied, while the 


Center had demonstrated that the expected re- 
lationships did not hold here any more con- 
sistently than in the case of age, education, or 
father's occupation. Frequently men of obviously 
modest intelligence were loudest in their de- 
nunciation of their way of life, while an occa- 
sional college graduate, perhaps a vagrant since 
shortly after his graduation from college, might 
profess to love his way of life and to harbor 
not the slightest desire to change it. This im- 
pressionistic evidence of a discrepant relation- 
ship between intelligence and satisfaction with 
unemployment had the disadvantage of being 
based solely on observation of the men's be- 
havior and on their orally expressed statements 
of satisfaction and dissatisfaction. Consequently 
this study investigated intellectual functioning 
by means of a standardized intelligence test and 
satisfaction by means of the Satisfaction Scale 
described below. 

The intelligence test used was the Otis Self- 
Administering Test of Mental Ability, Higher 
Form D. This test consists of 75 items, requiring 
a certain amount of verbal facility and ability 
to see logical relationships. 

The Higher Form of the Otis is intended 
for high-school students and college freshmen. 
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It was originally planned to use the Inter- 
mediate Form, designed for grades 4 to 9, in this 
study. However, in a previous study the educa- 
tional levels of applicants at the Center suggested 
using the Higher Form, the mean grade com- 
pleted being slightly above the tenth grade. 

Interests, The Strong Blank was completed 
according to the instructions printed on the 
blank. The time required for completion of 
the 400 items ran from 15 minutes to about 
one hour, with a mean of approximately 25 
minutes. A pilot study attempted to determine 
whether difficulty in comprehension would be 
presented by certain items. No such difficulties 
were encountered in 20 cases so studied, the 
men apparently understanding names and terms 
used as well as might be expected of a group 
of this educational level. 


Satisfaction. The most important single factor 
subjected to investigation in this study was the 
relative satisfaction or dissatisfaction of the 
applicant with his vagrancy. The most promis- 
ing method of determining this relative satis- 
faction or dissatisfaction appeared to be by 
means of a series of scaled responses, ranging 
from those indicative of utter dissatisfaction to 
those signifying complete satisfacy ` ` 
Scale existed; and while it wou: 


* 


een 
Possible to construct one, the 1 ча 
appeared to be disproportionate | an- 
tages such a scale might offer. 

A more practical approach sugg" *1f in 


the form of Hoppock's Job Satisfaction Blank 
(31). This blank has been widely used and has 
been proved to be of value in the determina- 
tion of job Satisfaction or dissatisfaction. It 
consists of four Scales, made up 
ten items, the responses to whi 
in Order to obtain а composi 
faction. In this manner it is 
the degree Of satisfaction o 
quantitative terms, 

This blank w. 
“having-no-job” 
Satisfaction, retain 
altering the wordi 


€ scale are equidistant, and sec- 
qually important 


The Nonchronic Test Group 


For each applicant who was found to 
be a “chranic” and was tested, a “non- 
chronic” was administered the same bat- 
tery of tests. The first nonchronic we 
appeared each time a chronic was locatec 
among the incoming population was se- 
lected for testing. A total of 175 d 
chronics completed the battery, ege 
à total of 174 chronics. For reasons E 
satisfactorily explainable, since the n 
involved in the intelligence test was рге" 
sented to them in the same manner, none 
of the nonchronics was unwilling to nu 
plete the Otis, whereas 23 chronics T€ 
fused to do so, 


Treatment of the Data А 

Otis tests were hand scored according 
to the instructions in the test manual. 
Total score, the number of correct M 
Swers, was checked twice in order to и 
sure that no computational errors hac 
been made. 1 

The Strong Blanks were hand a 
rescored by a second person, and in Е 
case of a discrepancy between first а 
second scoring were scored a third ies А 
The final score represented a compro 
mise between the third score and the on€ 
closest to it when there was not pe 
agreement with one of the other two. i 
the Strong data were treated in raw 5016 
form, Я 

Responses to the Satisfaction үөр, 
were tallied and a composite "index 3 
satisfaction” was obtained. The item p 
Sponses indicating the greatest degree о 
dissatisfaction were assigned a weigh, а 
1. The others were given values ш x p 
from 2 to n, the latter representing sips 
total possible number of items in а ped 
ticular scale, Tt was then possible to y 
tain a scale value in terms of the бар 
deviation. Deviations in the direction 


THE OCCUPATIONAL LEVEL SCALE AS A MEASURE OF DRIVE 7 


dissatisfaction were given a minus weight. 
Those in the direction of satisfaction 
were assigned a plus weight. In this man- 
ner it was possible to reduce the scores 
on each of the four scales to comparable 
units, and the scale values of the items 
checked were added to obtain the index 
of satisfaction. 


Fathers’ occupations were quantified 
by means of the Barr Occupational Scale. 
This scale was originally employed by 
Barr and Terman (3) in studies of gifted 
children, and has been widely used since 
1925. It assigns numerical scores to well- 
known occupations, leaving adequate 
space between the scores for the inter- 
polation of other occupations not men- 
tioned in the scale. In the case of occupa- 
tions not specifically mentioned in the 
Barr Scale, a panel of five psychologists, 
all with special knowledge of occupa- 
tional requirements, arrived at a Barr 
score for each occupation, based upon 
estimates of the level of intelligence re- 
quired for placement in the occupation. 
For the not-so-well-known occupations, 
reference was made to printed job de- 
Scriptions, to occupational monographs, 
and to the Dictionary of Occupational 
Titles (57). 


Personal Data 


Chronics. Barr Scale scores of the fathers of 
the chronic group ranged from 3.62 (laborer) 
to 18.10 (president, insurance company). The 
mean score fell approximately one-half the dis- 
үз between the occupations of potter and 
" Пот. Seven of the applicants were unable to 
Aen what their fathers’ occupations were 
SE of these seven had any idea who his 

Cr was. 
PEL mean age of the men in the chronic 
the р Was 46.97 years. Most studies have found 
of eps age of vagrants to be in the vicinity 
tion Le with a steady decrease 1n the propor- 
Wer older men. The four applicants who 
* under go were excluded from this group. 


he tota] я 5 
years, range of ages was from 31.33 to 66.50 


Most surprising was the high average educa- 
tional level claimed. Previous investigators have 
noted a tendency for vagrants to exaggerate 
their past accomplishments, including their edu- 
cation. A comparison of the statements of these 
vagrants with those made in other studies re- 
veals, however, that whereas the latter groups 
usually averaged five or six years of school, 
the chronics in this study claimed a mean 
level approximating the tenth grade. There is 
no obvious reason why these men would have 
exaggerated their educational accomplishments 
any more than previous groups studied. It 
therefore seems reasonable to infer that these 
subjects had a higher average level of educa- 
tion than other groups studied, This may well 
be in part a reflection of the general increase 
in education (two grades) in the adult popula- 
tion in this country during the interim between 
World Wars I and IL. The range of claimed 
education in the chronic group was from the 
fourth grade to the Ph.D. degree. The latter 
claim was investigated and verified. 

Indices of unemployment ranged from 51 to 
95, indicative of unemployment from one-half 
to more than nine-tenths of total working life. 
(Тһе "on for designation "chronic" was a 
i | Ay ving been unemployed during more 


5 
Ў\Е of one's total possible working 


«applicant earned an index of 100, 
t that cven the *most-chronic" of 
: claimed some employment. Only 
two sacs earned an unemployment index 
greater than 86. 

Nonchronics. Fathers’ occupations in the 
nonchronic group ranged from laborer to 
lawyer. As in the case of some chronics, some 
(25) of the nonchronics were unable to specify 
the occupations of their fathers for similar 
reasons. Mean Barr score of the fathers of the 
nonchronics was 8.05, equivalent to the occu- 
pation of carpenter. 

Because men younger than go were not ex- 
cluded from the nonchronic groups, the range 
of age was greater, from 21 to 67.18 years. 
Mean age was 45: The upper extremes of the 
chronic and nonchronic groups were approxi- 
mately equal, and in the two groups the per- 
centage of men older than 5o was about the 
same, 32 and 37 per cent, respectively. 

Again, as in the chronic group, the men 
claimed a surprisingly high educational level., 
The average nonchronic claimed to have com- 
pleted approximately ten years of school. The 
total range of grades was somewhat greater 
їп this group, from no formal education 
(claimed by four men) to the M.A. degree (one 
man). 

Indices of unemployment in the nonchronic 
group ranged from 1 to 50, with a mean of 
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33-94. This is indicative of a history of almost 
no unemployment during total possible working 
life to a history of having been unemployed 


25 and 50, indicating that even among the non- 
chronics there were few who had histories of 
Teasonably steady employment, 


Test Data 


Chronics, The chronics’ mean Otis Taw score 
Was 44.44, the equivalent of an IQ of 102, a per- 
centile rank of 55. and a classification of “nor- 
mal” according to Otis norms. Raw scores 
ranged from 23 to 72, representative of IQ's 
from 81 to 130 and of classifications from “dull” 
to "superior." These intelligence test results 


, the 
arkedly 
nor Strongly dissatisfied, although 8 

i complete satisfaction 
К 


—129 to 206, with a 
mean raw score Of —.158, and а standard devia. 
lion of 55.99, Strong's one thousand m 
from —200 to 240, wi 
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“normal.” The standard deviation of the Otis 
raw scores is 10.39. ee d 

Owing to a t — of Otis jee ae 
tions by one of the two persons responsi Са 
the administration of the Otis tests, the chro + 
were not limited to a go-minute time limit e 
the nonchronics were, The estimated mean 
time required by the former was DcHNeen 95 
and 40 minutes, Consequently, direct comp o 
son of intelligence test scores of the two AS 
is misleading. Nevertheless, the close Sagi 
lency in mean scores and in range and nci 
deviation Suggests that under more d be 
equated conditions little difference would 
found between them. 8 to 

Indices of satisfaction ranged from —6.4 eed 
8.93, there having been one man who Hao 
complete Satisfaction. and ten who ind Ies E 
complete dissatisfaction. The mean inae ie 
—-554 indicates, as in the case of the ee 
group, that the average nonchronic was ^ vam 
Strongly satisfied nor dissatisfied with e in 
rancy, tending to be relatively indifferen 
terms of the Satisfaction Blank. at 

The nonchronics showed a SE ДАНЫ, 
range of OL scores, the extremes being rosis 
and 181. The mean raw score was 28.4 t арты, 
mately equivalent to the occupation of pne the 
and fell about ten raw score points above 
mean of Strong's criterion group. 


cr 


Results 


: -correla- 
Table 1 and ә present the ierit 
tions of all factors in the chronic and no 
chronic Broups, respectively, 


Chronics and Nonchronics 


Chronics. It will be recalled that 
negative relationship between OL and - 
Bree of satisfaction with vagrancy у 
hypothesized, Providing the OL ун 
related to motivational] and/or aspira 
tional factors, This hypothesis was x 
ported in the chronic group by our an 
ing a Product-moment correlation E 
7778 between OL and index of снн 
tion. In order to investigate the иш 
of the other factors included for ae 
ie. education, intelligence, age, fathe t 
Occupation, and index of unemploymen : 
first-order correlations were compu ms es 
OL and index of satisfaction, holding : a 
other factors constant, These partial CO 
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TABLE I 
INTERCORRELATIONS OF ALL Factors: CHRONICS 


gy 2 3 4 5 6 7 

(1) Occupational Level 174 —.73* їй. =b лоў — —.10 .28* 
(2) Index of Satisfaction 174 —.19* .05 = .26* 12 —.23* 
(3) Father's Occupation 167 —.12 “got FTA .59* 
(4) Age — 174 ло —.09 —.22* 
(s) Education 174 —.14 .49* 
(6) Index of Unemployment 174 cies 
(7) Intelligence 151 


* Significant at 1% level. 
t Significant at 5% level. 


relations indicated that the other factors 
exerted little influence on the zero order 
correlation of —.73, the greatest diver- 
gence being observed in the case of in- 
telligence, which, when held constant, re- 
sulted in a first-order correlation of —.78. 

OL and age were found to correlate 
—.06, a figure that is statistically insigni- 
ficant, Strong (49, p- 189) presents con- 
flicting information concerning his find- 
ings with respect to OL and age. For his 
one thousand men in general, Strong 
found a slight increase in OL with in- 
creasing age, but no change in follow-up 
data on high-school juniors. He con- 
cluded that an increase of from two to 
three OL standard score points might oc- 
cur with increasing age, but that age 
affects OL very little. 

Claimed education and OL correlated 
-19 in the chronic group and —.19 in the 
nonchronic group. These correlations are 


significant at the .05 level. The reason 
for the discrepancy is not apparent. 
Strong does not present data concerning 
the relationship between education and 
OL. Indirectly he makes reference to it 
in his discussion of the relationship be- 
tween age and OL, for in his younger 
groups there was, of course, a direct rela- 
- between age and grade in school. 
vationships between index of 
1 and other factors were gen- 
4 ‘pected. Correlations of —.19, 
— MES. —.25, all significant at the .o1 
level, were found between satisfaction on 
the one hand and father's occupation, 
claimed education, and intelligence on 
the other. Thus, chronics claiming higher 
fathers' occupations tended to express 
greater dissatisfaction with unemploy- 
ment. Similarly, the more intelligent men 
and those claiming higher educational 
attainments were less satisfied with unem- 


tions” 


TABLE 2 
INTERCORRELATIONS OF ALL Facrors: NONCHRONICS 
N 2 ё 4 5 б 7 

m Occupational Level 175 .68* 24* 30 10] —.39*  —.24* 
vi ndex of Satisfaction 175 —.41* 97 =з. 46* =at 
Father's Occupation 564 — .oof 26 = gh 65* 
e Age 580 —l14*  —.o; NIC 
(e Education 5809 А Eo 
(5) ndex of Unemployment 589 ses. 
7) Intelligence 175 


* Sion; ы 
Significant at 1% level. 
ignificant at 5% level. 
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ployment than the less intelligent and 
not-so-well educated, 

Strong (49, Р. 201) reports a correlation 
of .05 between ОТ, and intelligence as 
Ineasured by the Thorndike Intelligence 


cerning educationa] accomplishments and 
fathers’ occupations received some sup- 
port from correlations of .59 and -49 be- 
tween these two factors and intelligence 


in the chronic 8roups, and of 44 and .65 
in the nonchronic groups. 


» 45 was done in the 
ther fac- 


Case of the chronics, Again, the о 
tors were shown to be contri 
tle to the observed correlatio 
est divergence being noticed 


(* 
nix; T 


‚ Te- 


"05 level, in the chronic 
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and lower. The chronics, on the other 
hand, were largely individuals who had 
renounced any claim to, or interest н. 
employment, Thus, the passing years -— 
not resulted in their lowering their vo- 
cational ambitions, Strong’s finding of a 
slight increase in OL with advancing age 
was based on average people who Wed 
presumably fairly well adjusted to their 
work; thus their aspirations tended to 
БО up rather than down. 

A correlation of —.30 was found be- 
tween OL and father’s occupation in the 
nonchronic group. This correlation 2 
Significant at the -01 level, contrastec 
with the statistically insignificant correla- 
tion of 14 in the chronic group. E 
Negative correlation Suggests a partia 
answer to the question of why these men 
became vagrants. The men claiming 
higher fathers’ occupations should be - 
pected to earn higher OL scores, d 
being a positive relationship between o 
and intelligence, and between fathers 
Occupation ang intelligence, The negt 
tive correlation Suggests that while the 
men from the relatively better homes sug 
Sested by the higher fathers’ occupations 
did tend to be more intelligent than men 
claiming lower fathers’ occupations, they 
were, nevertheless, handicapped toa ай 
tain extent by having interests not сона 
mensurate with their socioeconomic a 
els. This may explain their having faile 
to become useful members of society, za 
factor or factors implied by a low о 
“core having operated in their becoming 
vocationally and Socially maladjusted. 


Satisfied Versus Dissatisfied i 
In order to point up the p o-- 
among the factors studied, the caron 
and the nonchronic groups were bom 
divided into “Satisfied cad “Dissatis: 
subgroups, This was done by des 
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ignating those whose satisfaction indices 
fell above the third quartile of each 
distribution as "satisfied" and those 
whose indices fell below the first quartile 
as "dissatisfied." The score limits in the 
chronic group were 2.00 and above for 
the satisfied and — 2.42 for the dissatis- 
fied. Similar critical scores in the non- 
chronic group were 1.70 and —2.91. 

The critical ratio was employed to test 
the significance of the differences between 
various scores of the chronics and non- 
chronics, as well as between scores of the 
Satisfied and dissatisfied subgroups. Two 
factors differentiated the chronics from 
the nonchronics at the .o1 level. The 
latter earned significantly higher OL 
Scores and had higher fathers’ occupa- 
tions. None of the other factors, i.e., age, 
claimed education, intelligence, or index 
of satisfaction, differentiated between the 
chronics and the nonchronics. 

The same two factors, OL and father's 
Occupation, showed differences signifi- 
cant at the .o1 level between the satis- 
fied and dissatisfied nonchronics. The 
satisfied and dissatisfied chronics differed 
Significantly with respect to OL and 
claimed education. Using the quartile ex- 
tremes, as described above, did not dem- 
onstrate significant differences in claimed 
fathers’ occupations in the chronic group. 

Applying more stringent criteria for 
designation as satisfied and dissatisfied, 
all the distributions of satisfaction in- 
dices were recalculated, using the upper 
and lower deciles instead of quartiles. 
With this new criterion in effect one 
change was observed: fathers’ occupations 
claimed by the satisfied and dissatisfied 
chronics now differed at the .о1 level of 
confidence, 

Thus two factors, father’s occupation 
and OL score, differentiated not only be- 
tween the chronics and nonchronics but 


also between satisfied and dissatisfied 
members of both groups. In only one in- 
stance, that of the satisfied and dissatis- 
fied chronics, did another factor (claimed 
education) differentiate significantly be- 
tween these paired groups. None of the 
other factors approached the level of sig- 
nificance observed in the case of OL and 
father's occupation. 

While these two factors differentiated 
significantly between the dichotomies es- 
tablished, the sizes of the correlations 
between them in the chronic and non- 
chronic groups, .14 and —.24 respectively, 
ruled out any assumption that one could 
predict the occupation of a vagrant’s 
father from a knowledge of his OL score. 
It follows that the factors represented by 
fathers’ occupations, particularly socio- 
economic background, and by the OL 

3 ek "ted separate, albeit similar, in- 
71У. the men studied. Not only 
chronic vagrants be distin- 
от the nonchronics on the 
"father's occupation and OL 
score, but within these two groups the 
satisfied and the dissatisfied could also be 
isolated. 


Conclusions 

Negative correlations of —.73 and 
—.68 were found between OL score and 
index of satisfaction with unemploy- 
ment in the chronic and nonchronic 
groups respectively. This might lead one 
to accept the hypothesis that the OL 
score provides a measure of level of as- 
piration, at least vocationally speaking. 
As OL scores increased in magnitude, ex- 
pressed satisfaction with vagrancy de- 
clined. 

However, another factor, father's occu- 
pation, also was negatively correlated 
with satisfaction with unemployment and 
differentiated between the satisfied and 
dissatisfied men in both the chronic 
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(—-19) and nonchronic groups (—.41) as 
well as between the groups themselves. 
The subjects’ expressed dissatisfaction 
with unemployment should not, there- 
fore, be viewed in terms of high OL 
Scores alone. Nor could the nonchronics 
be distinguished from the chronics solely 
on the basis of their OI, Scores, In each 
case, father's occupation also entered the 
relationship. Furthermore, OL scores and 
fathers' occupations were not significant- 
ly correlated, thus ruling out the possi- 
bility of equivalency of OL score and 
father's occupation, In fact, in the non- 
chronic group OL scores and fathers' 
occupations were significantly negatively 
correlated. This Suggests that possession 
of a level of occupational interest not 
commensurate with original SOCioeco- 
nomic leve] may be responsible in part 
for social and vocational malad’ с” sont. 


These data cannot be said to have 
demonstrated that the OL scale measures 
drive. They have shown that it is ge 
lated to status satisfaction, and that it is 
not simply a measure of parental socio- 
economic level. While it apparently ор" 
erates in the same way as the latter, 1t 
is independent of it. Perhaps the OL 
scale measures just what its method of 
construction suggests: the occupational 
level to which the individual's interests 
correspond. The scale might therefore be 
of use in a guidance or selection battery 
as an index of the occupational and/or 
social level which the individual i$ 
likely to find congenial. It is, in a sense, 
a measure of satisfaction or dissatisfac- 
tion with a way of life. If it is also à 
measure of drive, this remains to be dem- 
onstrated. 


CHAPTER ПІ 


THE RELATIONSHIP BETW 
AND VARIOUS MEASURES OF 


EEN OCCUPATIONAL LEVEL (OL) SCORES 
ASPIRATION AND ACHIEVEMENT* 


1вуїхс HANDELSMAN 


1" THE present experiment, the OL 
score (Strong’s Vocational Interest 
Blank), laboratory tests of level of aspira- 
tion, and teachers’ ratings and students’ 
self-ratings of level of aspiration are used 
as measures of level of aspiration. The 
extent of student participation in extra- 
curricular activity and three-year high- 
school grade averages are used as meas- 
ures of achievement which should, on a 
priori grounds, be affected by aspirational 
level. 

The OL scores may be hypothesized as 
reflecting the individual's socioeconomic 
goals in life. The teachers’ ratings and 
the students’ self-ratings of level of as- 
piration are considered to be indices of 
the manifest motivation and striving of 
the student, The extent of student par- 
ticipation in extracurricular activity and 
high-school grades are believed to de- 
pend, in part, upon the student's gen- 
eral level of aspiration in his daily liv- 
ing, and are behavorial in nature. On the 
other hand, it is believed that the lab- 
Oratory tests of level of aspiration. are 
more specific and less related to life sit- 
uations, and measure the individual’s as- 
pirational level in tasks of limited sig- 
nificance. There is a dichotomy in these 
Measures of level of aspiration, with one 
group representing life situations in the 
broad sense whereas the other group is 


unrealistic and narrow in scope. 

бе of ап Ed.D, investigation conducted 

the cachers College, Columbia University, under 

des г of Dr. Donald E. Super, Dr. 

Dr IE F. Shaffer, Dr. Nicholas Hobbs, and 
+ Irving Lorge. 
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Problem and Method 


The present study proposed to deter- 
mine to what extent the above-men- 
tioned, presumed measures of level of as- 
piration are related to each other as well 
selected factors. The aspect 
s to deter- 


as to other 
of the problem reported here i 
mine the degree of relationship between 
the OL score of the Strong Vocational 
Interest. Blank and various other pre- 
sumed measures of level of aspiration, 
such as teachers’ ratings of students’ level 


of aspiration, students’ sel[-ratings of 
levis spiration, and two laboratory 


vyel of aspiration. Secondly, an 
made to ascertain whether any 
єр exists between the OL 
scor “i scholastic and extracurricular 
achievement. The third part of the study, 
not reported here, was concerned with an 
investigation of the nature and mean- 
ing of two laboratory tests of the level 
of aspiration. 


с 


Design of the Study 

Sample. The experimental group con- 
sisted of 132 white male students who 
were members of the junior and senior 
classes of two high schools in a suburban 
community located about 30 miles from 
New York City. The schools are referred 
to as “School A" and “School B." Sixty- 
four subjects participated in this study 
from School A, while 68 students par- 
ticipated from School B. The average 
age of the students from School A is sev- 
enteen years and nine months (SD 9.0 
months) while the average age of the 
students from School B is seventeen years 
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and ten months (SD 8.8. months). The 
average IO, derived from the Otis Self- 
Administering Test of Mental Ability, 
Higher Examination, Form A, is 105.7 
(SD 10.8) in School A and 107.6 (SD 
10.1) in School B. 

The laboratory tests of level of aspira- 
tion. The two laboratory tests used for 
measuring the level of aspiration were 
designed by the writer, The verbal test 
consisted of paragraphs in which the 
subjects were asked to réad the material 
-and to put a line through all the written 
words which were numbers. The arith- 
metical tasks involved the computation 
of simple three-digit, three-row problems 
in addition, Copies of the instructions 
and the tests are contained in 
nal manuscript (27). 

The range of intercorrelations of the 
five performance trials of the ; E 
level of aspiration test is ы 
with a median coeffitient of cor =: 
68 in School A, while the ran} 


the origi- 


er- 
correlations is from -76 to .88 \ 4 me- 
dian coefficient of correlation of -84 in 


School B. 


The rating scales of level of aspiration. 
Two five-point rating scales of level of 
aspiration were designed (Appendices B 
and C). The scales were identical, except 
that the teacher ra ting scale was descrip- 
tive of the students’ drives and was writ- 
ten in the third person whereas the stu- 
dents’ self-rating scale was written in the 
descriptions ranged 


“... Sets no goals .. .” to « 
high goals...» 


Procedure 
The intelligence quoti, 
Was obtained as recommende 


» Which 
the respective 


Strong Vocational Interest 
ed to the subjects by the 


experimenter and scored by machine. aa 
The level of aspiration scores. The Jiel в 
aspiration was obtained for cach test by find ing 
the mean differences between the ре оша 
Scores and а$рїгта!їоп scores for the five ee 
The average level of aspiration score ы pe 
puted by taking the mean of the verba ыз 
arithmetical aspiration scores. Since the кш 
dents were asked to count the number of E 
lems they had completed and record Шеш, а 
check was made to ascertain the degree Fe 
accuracy with which the students scored еы 
selves. A check of the ten trials for the 132 a 
dents revealed that 6 erred, once each, in зо 
ing the proper score. Three students ane 
estimated their scores by one, and 8 Mu 
mated their scores by onc. It appears that ds a 
errors were unintentional and that the diffe 
ences are probably due to chance errors. t 
Instructions for student and teacher тай 
In each school the teachers who were ase 
to rate the students participating in the m 
met with the experimenter and were instruc ly 
to “check the item which most appropriée 
describes the level of aspiration or drive of fol- 
student in his everyday life.” A discussion hat 
lowed the instructions, and it appeared; Г 
there was a common understanding as to t 
meaning of the terms, sent 
The students participating in the ехрегипе a 
were instructed to “check the item which уме 
feel most appropriately describes you in уо, 
everyday life.” А few questions were raised aT 
the students, but there seemed to be a genen 
understanding of the terms, jaye 
Academic achievement, Academic роз 
ment was determined from the school Et 
Averages. Six semesters of work were used he 
the junior classes, and seven semesters in r 
case of the seniors. The percentage method ols. 
grading students is employed in both peo 
The Extracurricular Activity Index. T by 
tracurricular Activity Index ‘was obtained ich 
asking the Students to fill out a form on s 
they recorded the names of any school organ! In 
tion, club, or team to which they belonged. A 
addition, they were told to indicate the a. 
ber of terms they were members and the wee 
ber of terms they held office. One point Me 
given for membership and an additional Pea 
for each term that an office was held. The st c- 
total of points yielded the Extracurricular 
tivity Index. 
Results 5 
Since the Study was conducted in ME 
different Schools, the null ee. н 
set up in the case of each variable pi 
each school. It is assumed that there 


Н о 
no real difference between the means 


y THE OCCUPATIONAL LEVEL SCALE AS A MEASURE OF DRIVE 15 
TABLE 3 
MEANS, STANDARD DEVIATIONS, AND CORRELATIONS FOR EACH OF THE 
VARIABLES IN SCHOOL A (N—64) 
— — = = s = 
Variable 1 2 3 " 5 6 7 8 9 то Mean Sigma 
L SE Score = азж  .44* —-004 -42* 26t, -05 17 °з ast 48.6 6.9 
2. Three У; & bd 2 
as EES Nt — газе .39* .63*  .33* -19 .20 .21 .65* 78.4 7.2 
3. Students — Self-Rat- 
UN PRUE sat qe .o7 .41*  .32* 14 28 чё a Ea m 
ME E E = -. —.04 or =. 212. ч 
$ ig UB 35 » HAC. Ur iE a ast .o8 .46* 105.7 10.8 
É Pecans Ate 558 4 
tiri Index аг ii .26t  .33* .32* —.02 “ЗЇ — „оз -—.16 —.0$ .3s* 26.9 26.7 
7. Verb 3 " à 
L 8 мара Level бле .о5 ло Em 105 —-.o0t .o3 -— 35* ọ4* Зої 64.6 26.0 
3 . Arith i T 
T Aspiration Level: ar ат 0.20 .28} —.°4 vast —-16 -35* T 62%  .23 571 9-4 
9. "ra La As- 
piration svekar 28 .os .21 E or o8 os 93%  .62* — ag* 61.6 14.8 
1o. 00 Leachin Rat- Ф 
ngs of Students L h P е \ 
IngeofStudentsLevel з Que gg codo Gt Ду "a -20ї 8.7 3-4 
* Significant at the .от level of confidence. 
+ Significant at the .os level of confidence. 
f Age measured to nearest month. 
d У 
the two populations, that any differences tion, and total teachers а of stu 
are nonsignificant and might easily arise dents’ level of i m ae: a 
ү $ A iti ioni i in the extent ot par- 
" from sampling fluctuations. The critical significant difference in the р 


ratio is computed for each variable апі ticis" їп extracurricular activity Н 
the level of confidence selected for reject- € Viv» students in the two schools. 
ing the null hypothesis is .01. S 

The two school groups are evenly 
matched as to OL scores, academic 
achievement (high-school average for X к 
three years of work), students’ self-rating OL scores and teachers ratings. А 
of level of aspiration, age, intelligence, mean OL score for School A is 48.5 ү 
discrepancy scores on the arithmetic and 6.9) and for School B it is 48.8 (SD у 
verbal laboratory tests of level of aspira- The correlation coefficient between the 


ive as Related to the Various 
Measures of Level of Aspiration 


TABLE 4 


ү ip CORRELATIONS FOR EACH OF THE 
EAN NDARD DEVIATIONS, AND TI 
ipe VARIABLES IN SCHOOL B (N=68) 


s ER 
TR $ 3 P 6 7 8 9 то Mean Sig 
rable т 2 
‹ 8.8 6.8 
1. OL Score = Hep Јер o .20 .o3 .18 .o6 .16 x 4 P 
2 BUNT Year H.S. Av- i ast әт so* -20 лї —.02 .o8 zr 97-2 x 
rage «30 = . “+ 3 
3. Student": Rati! ES = —.08 36* 3.2 Tet 
of Dd SEE Rate o4 и n ast зоў set с = Ed .04 102 213.6 8.8 
; pacc a t `0] 107.6 тоа 
® Me =i —.21, saa = — "22 lar .10 .29 .29 . 
Е 20 +50" 
б. Extracurricular Ac- Р ee ер йй 28 Эа 
tivity Index +03 .20 38% +02 = 
7. Verbal Level of As- E РА $1* —.18 — 66t .97* 12 72.5 19-4 
ration ud АЁ oe . 
8. Arithmetic Level of PE) 66* — .82 ол 58.0 8.4 
$ Aspiration jd ча ee AR 
` Average Level of As- " 8925 65 ETI .aob — -17 .97*  .82* — 15 65.8 12.0 
To, Тош! Teachers Rat- ` : " 
s — o. y 
of мор мара at т .36* «02 .aob -17 .12 +04 Ei 3 3 


M Significant at the .or level of confidence. 
å i Significant at the .os level of confidence. 
Age measured to nearest month. 
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OL scores and the teachers’ ratings of 
their students’ levels of aspiration is .25 
for School A and -23 for School B, both 
significant at the -05 level of confidence. 

OL score and students’ self-ratings. 
Considerable difference is noted in the 
correlation of-scores with students' self- 
ratings of aspirational level. In School A 
the correlation coefficient is 44 (P = .о1), 
and in School В it is .04. 

OL score and the experimental tests 
of level of aspiration. The relationships 
between OL scores and the laboratory 
tests of level of aspiration are not signifi- 
cant. The correlation between the verbal 
level of aspiration tests and OL scores is 
:05 in School A and .18 in School B. The 
correlation between the arithmetic leve] 
of aspiration test and OL scores is 17 
in School A and 06 in School B. 

Discussion. The OL scores 4 dosi- 
tively related to teachers’ та) Б 
dents’ level of aspiration in both; "a 
whereas they are significantly re! 
Students’ self-ratin 
in School A but not in School B It ap- 
pears that there js consider. 


in objectivity of student 
their level of aspi 


ot significantly re- 


lated to laboratory tests of level of aspira- 


tion, 


Score as Related to Academic Achieve- 
ment, Intelligence, and Extracurricular 
Activity 
OL score and IQ. The correlation be. 
tween OL scores and IQ is 42 (P — :01) 
E School A, and 20 (P :05) in Schoo] 


in School A and -30 (P — .05) in School 
B. When intelligence is held constant, the 
correlation becomes .24 and .22 respec 
tively. It is found that the multiple cor- 
relation between academic achievement 
and OL scores and IQ is .66 in School 
A and .54 in School B. - 

OL score and Extracurricular Activity 
Index. The correlation between aoe! 
pation in extracurricular activities an 
OL scores is .26 (P —.os) in School A 
and .03 in School В. Р 

Discussion. The above findings are 1n 
agreement with those of Wren (58), оар. 
ley (8), and Stubbins (50), who, using dit- 
ferent research techniques, found intelli- 
gence and academic achievement to s 
highly related to an individual's level o 
Occupational aspiration, However, they 
are not in agreement with those of Strong 
who found that the correlation between 
OL scores and intelligence is .on. When 
intelligence is held constant, the correla- 
tion between OL scores and academic 
achievement is positive, but no longer 
significant, In the multiple correlation of 
academic achievement to the OL scores 
and intelligence, the correlation соећ- 
cient increases slightly. The multiple and 
Partial correlations reveal that intelli- 
gence is the most important factor in aca- 
demic achievement, The relationship be 
tween the OL scores and the Extracur- 
ricular Activity Index does not appear tO 
be clearly Significant or close, 


Conclusions 
The pur 


А e- 
Pose of this study was to d 
termine th 


е degree of relationship which 
exists between the OL score of the Strong 
Vocationa] Interest Blank and various 
other Presumed measures of level of as- 
Piration, such as teachers’ ratings of ins 
dents’ leve] Of aspiration, students' = 4 
ratings of level of aspiration, and two 


mewa 
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laboratory tests of level of aspiration. 
Secondly, an attempt was made to ascer- 
tain whether any relationship exists be- 
tween OL scores and scholastic and extra- 
curricular achievement, The experimen- 
tal group consisted of 132 white males 
who were in the junior and senior classes 
of two high schools about 30 miles from 
New York City. 

The results of this study seem to war- 
rant the following conclusions: 

1. The OL score (Strong's Vocational 
Interest Blank) is positively but not 
clearly significantly related to teachers’ 
ratings of students’ level of aspiration. 

2. No significant relationships exist be- 
tween the OL scores and the several lab- 
oratory tests of level of aspiration. How- 
ever, there is some degree of relationship 
between OL scores and the other meas- 
ures of level of aspiration. 

3. There is a significant relationship 
between OL scores and academic achieve- 
ment, but when intelligence is held con- 
stant, the coefficient of correlation is posi- 
HG but no longer significant. In a mul- 
tiple correlation of academic achieve- 
ment with intelligence and OL scores, 
the correlation coefficient increases 
slightly. It appears that the OL score is 
not useful as a predictive tool for aca- 
demic achievement. However, the data re- 
veal that an individual’s OL score is re- 
lated to his intelligence and academic 
achievement. How the individual ap- 
praises his abilities and achievement ap- 
pears to determine to a great extent the 


CALE AS A MEASURE OF DRIVE 17 


level of his choice of occupational goal. 

4. There is no clearly significant rela- 
tionship between OL scores and the ex- 
tent of student participation in extracur- 
ricular activities. 

5. Although there are differences in 
the population, it has been found that 
OL scores are positively related to intel- 
ligence. 

Level of aspiration is highly specific. 
One cannot infer from the data in Tables 
3 and 4, not all of which have been 
discussed in this paper, the presence ofa 
general trait "level of aspiration.” The 
conduct of an individual is due to fac- 
tors common to the situations represented 
in the test. Actions in a wide range of 
situations cannot be predicted from 
knowledge in one type of situation, since 
the varied situations are not sufficiently 
кы to elicit a common response from 


vidual. 

L scale of Strong's Vocational 
Blank is not significantly related 
to t ther measures of level of aspira- 
tion, and is of little value as a predictive 
instrument of academic or extracurricu- 
lar achievement when intelligence is held 
constant. The interpretation of the OL 
scale as a measure of level of aspiration 
is apparently not warranted. The OL 
score is SO constructed that it should 
indicate the socioeconomic level of an 
individual's interests, but there is no evi- 
dence to suggest that it measures his level 
of aspiration or drive. 


CHAPTER IV 


THE RELATIONSHIP OF CERTAIN SOCIAL FACTORS TO 
OCCUPATIONAL LEVEL AS 


VOCATIONAL IN 


MEASURED BY STRONG'S 


TEREST BLANK* 


Lawrence H. STEWART 


HIS study is concerned with the rela- 
aee between certain social fac- 
tors presumably operative during early 
childhood and adolescence and the indi- 


Hypothesis, Occupational level as meas- 
ured by Strong’s Vocational Interest 
Blank is, in Dart, a function Of social 
background, Sons of skilled workmen 
Whose social backgrounds vary from that 
to be expected on the basis of fathers’ 
occupations tend to make scorer“ 


OL key which vary from the men 
skilled group. j 


“Һе 
Ne 
id 


Problem and Method et 


Subjects, "The Subjects for th 


€ study 
were 136 high-school] juniors 


and seniors 


ary of Occupational Titl 


es (57). All of 
were 


selected from five 


commuting distance of, 
but not Within, New Yor 


the direction of Dr, Donald 


3 Ѕирег, Dr. 
Nicholas Hobbs, and Dr. Herbert Zucker, 
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made within the same or similar groups. 
With this is mind, Newark, N.J. ‘Was sg 
lected as a location likely to provide the 
desired number and variety of ke 
However, examination of data on the su h 
jects obtained at the West Side miga 
School in Newark showed that the ри 
Portion of Italian students was unduly 
large. In order to reduce the possibility 
of getting too many subjects of one ur 
tional origin, other neighboring comme 
nities were selected as a source for -the 
remaining subjects, d 

Sons of skilled workmen were perk 
for study, since the mean OL standard 
score of skilled workmen is арр 
mately Бо. This permitted the scores О 
the subjects to deviate in either direction 
from the mean Score of the skilled group. 
If either the Professional or unskilled oc 
cupational group had been chosen, E 

L scores of the sons could have deviate 
in one direction only, 


Satisfaction with the job depends, in es 
on the leve] of the job in the manual or whi p 
collar hierarchies (51). Skilled workers are er 
Satisfied with their jobs than semiskilled b 
Men; professional Workers more satisfied po 
clerical Workers, Davidson and Anderson би 
have shown that clerical workers are the PS 
the higher white-collar eu 
Semiskilled and unskilled iio 5. 
crs are the reservoirs for the skilled өшырапаи 
ing sons ор skilled workmen, who pe 
the manual hierarchy, ital 
have partially eliminated the effects of parer to 

issatisfaction and the desire of the paranes 


1€ occupational world. 
Colored Students and sons of foreign- 
Orn Parents Were excluded from the sam- 
ple, because jt was not known what ef 
fects race or foreign cultures would have 
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on the variables being investigated. 

Instruments. The OL scale of the 
Strong Blank, a form of the Otis Test of 
Mental Ability, and a questionnaire de- 
Signed to elicit information concerning 
the social background of the individual 
Were used in the study. The first two in- 
Struments have been described elsewhere 
(26, 49, 53). The questionnaire consists of 
49 items exclusive of identifying data 
(Appendix D). It can be divided into 
two parts: items concerning the subjects’ 
family background, and those concern- 
Ing the subjects’ activities either in or 
outside the home. 

Administering the instruments. The 
Strong Blank and the questionnaire were 
given to groups of from five to ten sub- 
Jects. In order to motivate the subjects, 
they were informed that the Strong scores 
Would be made available to them 
through their school counselor. After five 
Minutes practice on the Strong, they 
Were told to complete the blank outside 
of school, and attention was turned to 
the questionnaire, which was completed 
In the group. The use of small groups 
permitted the investigator to answer ques- 
tions and to check each questionnaire 
for omissions and: ambiguous answers. 
Either the Otis Quick-Scoring (Gamma) 
or Self-Administering (Higher) 107$ were 
taken from school records. The school ad- 
Ministered the Otis Quick-Scoring Test 
to a few students for whom Otis 1075 
Were not available. 

The use of two forms of the Otis tests 
raised the problem of comparability of 


IQ's. Information furnished by the pub-. 


lisher indicates that the Quick-Scoring 
averages about one raw score higher than 
the Self-Administering tests. Since one 
Taw score is roughly equivalent to one 
19 Point, Self-Administering IQ's were 

erted to Quick-Scoring IQ's by the 


addition of one IQ point. 

Statistical analysis. The analysis of var- 
iance was used as one variable was in the 
form of multiple categories and the other 
in continuous standard scores. 

Analysis of the data indicated that OL 
scores were not related to school or grade 
or clearly related to age. Therefore all 
of the subjects were considered as a sin- 
gle sample. 

Findings are summarized in Table 5, 
in which eight significant relationships 
are reported (three of which are family 
data and five personal), together with 19 
variables for which no relationship was 
found. $ 

Discussion 

The findings indicate that the mother 
may have a greater influence on the de- 
velopment of vocational interests than 

X.erto been assumed. Psychoana- 
ory stresses the tendency for the 
mulate the father, a fact which 

be at variance with the above 
findings. However, Strecker (48) points 
out that sons tend to be emotionally at- 
tached to their mothers. Such a viewpoint 
provides a logical framework for these 
findings, which suggest the following ` 
theory. 

The mother plays an important role 
in transmitting the development of cul- 
tural values and mores to the children, 
and therefore helps set the level of the 
son's vocational interests. Not only does 
the mother nourish the child physically, 
but she also provides a cultural atmos- 
phere, highly saturated with her own in- 
terests and values, which is influential in 
determining those of the son. This foun- 
dation, established during childhood, 
controls the interpretation of future ex- 
periences and, to a great extent, the for- 
mation of interest patterns. The father 
may help determine the vorational field 


20 BARNETT, HANDELSMAN, STEWART, AND SUPER 


TABLE 5 
SUMMARY or FINDINGS 


Related to OL Score 


o OL Score 


Not Related t 


Significant at the -05 level; 
Family : 
1. Mothers’ socioeconomic status as measured 
y: 
Occupation of maternal grandfather 
ccupation of materna] grandmother 
2. Religion of the family 
Subject 
3. Participation in hi 
4. Type of summer Work experience й 
5. Occupation expected after completion of 
ioi 


Significant at the .or level: 


6. Vocational and education 
pletion of high School 
7. Intelligence 


al plans after com- 


Family 


1. Occupational status of: . 
Members of immediate family 
Paternal grandparents 
Most successful relative 

erson most admired 

2. Educational level of relatives 
3. Ethnic origin 

4. arents’ birthplace ilv 
5. Financial status of friends of the family 
6. Type of dwelling 

7. Feelings concerning the neighborhood 

8. Parents' participation in organizations 

9. Supplementary income 
Io. Possessions at home 


Subject 

ті. Participation 
tions -— 

12. Holding offices in any type of organizatio 

13. Source of Spending money 

14. After-school work experience 

15. Travel 

16. Visits to museums 

17. Socioeconomic status of friends 

18, Long-range vocational aspirations 

19. Parental aspirations for the subject 


in out-of-school organiza- 


is available to 
e hypotheses, other than 


Conclusions 


The purpose of the study was to in- 
vestigate the relationship between cer 
tain socia] factors, presumably operative 

uring early childhood and adolescence, 
and occupational leve] as measured by 
Strong’s Vocational Interest Blank. 

A questionnaire designed to elicit 50- 
cial background information, the Strong 
Vocational] Interest Blank, and a form of 
the Otis Tests of Mental Ability were 
administereq to 136 high-school juniors 
and seniors Who were sons of skilled 
Workmen, Classified according to the Dic- 
tionary of Occupational Titles. The sub- 
J€cts were sons of white parents born 
in the United States. All of the subjects 
Were in schools Surrounding metropoli- 
tan New York City. 

. When а large number of variables are 
vestigated, a few seemingly significant 
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relationships may be expected on the 
basis of. chance. However, eight signifi- 
cant relationships out of 57 variables are 
more than the expected humber of 
chance relationships. 
It seems difficult logically to account 
an the fact that some of the variables 
мы to OL scores while other 
ned [dac similar factors are not 
Жа oi E suggests the possibility that 
Бена te quantitative information 
get at de kai questionnaire may not 
TI portant aspects of the problem. 
ier toa tentative conclusions 
stified: 
еа ч scores of sons of skilled 
des in t "e not related to discrepan- 
чеби socioeconomic status of the 
ate family as indicated by occu- 


pati sii 
- on of siblings and mother, educa- 


ice of the members of the fam- 
MS at home, supplementary 
Beogra i ca engaged in by parents, 
Pc ын mobility of parents, ethnic 
as n alee of social mobility such 
cioecon 85 toward neighborhood and so- 
dwelling status of friends, and type of 
g. 
sa 9L scores of sons of skilled 
cioeconor are related to the mothers so- 
Occupati mic status as determined by the 
8rand aes level of both maternal 
ever [ ате, These relationships, how- 
» аге not clearly significant. 
Works OL scores of sons of skilled 
tional le are not related to the educa- 
ternal Vel of maternal grandparents, pa- 
wei ратат; and most educated 
Paterna] ps the occupational level of 
relative grandparents, most successful 
» and person most admired. 
4 The OL scores of sons of skilled 


Wor т 
kmen are related to the religion of 


the family, although the relationship is 
not clear-cut. Sons of mixed marriages 
score significantly higher than sons of 
Catholics. Sons of Protestants score higher 
than sons of Catholics, but the difference 
is not quite statistically significant. 

5. The OL scores of sons of skilled 
workmen are related to activities such as 
type of summer work experience and be- 
longing to school organizations. The rela- 
tionships, however, are not clearly sig- 
nificant. 

6. The OL scores of sons of skilled 
workmen are not related to factors in 
the subjects’ environment such as mem- 
bership in out-of-school organizations, 
source of spending money, after-school 
work experience, travel, visits to mu- 
seums, and socioeconomic status of closest 


friends. 

To OL scores of sons of skilled 
fi n are clearly related to the indi- 
SUM immediate vocational or educa- 
tion&“plans. Those expecting to go to 
college score significantly higher than 
those who plan to get a job on leaving 
high school, go to a business school, or go 
to a technical institute. 

8. The OL scores of sons of skilled 
workmen are related to the type of job 
expected after completion of education. 
The relationship, however, is not clearly 
significant. 

9. The OL scores of sons of skilled 
workmen are not related to the subjects’ 
long-range vocational aspirations nor to 
the vocational and educational aspira- 
tions which they think their parents have 
for them. 

10. The OL scores of sons of skilled 
workmen are related to intelligence. The 
correlation is low but clearly significant. 


CHAPTER V 


THE MEANING OF OCCUPATIONAL INTEREST LEVEL AS 
а MEASURED BY STRONG'S BLANK 


DoNarp E. SUPER 


N launching the series of investigations 
I reported in the preceding chapters 
we had in mind questions such as the 
following: 


Is having interests like those of professional 
men a sign of motivation to strive to rise 
to the higher socioeconomic levels? 


Are adolescents with interests like those of 
business executives inclined to show, in their 
School work and activities and in their edu- 
cational and vocational plans, patterns of be- 
havior which can be interpreted as indications 
of high aspirational level? 


Are men whose level of occupational interests 
is high likely to be dissatisfied with a low 
level of vocational attainment, while those 
Whose occupational interest level ig^ tend 
to be satisfied with unemployment; jd 
and dependency? E. 

level simply a _ «sure 
hich an individual “has de- 
Which characterize one or 
arious socioeconomic levels? 

With what factors and 
outside of the home a 
pational interest levi 


Is occupational interest 
9f the extent to w 
veloped interests 

another of the v. 


experiences in and 
te differences in occu. 
els associated? 

The answers to these questions were 
Sought im a review of prev. 
of the OL scale of Strong's Vocational 
Interest Blank (the results of which have 
been omitted from this monograph), and 
in three investigations conducted with 
high-school boys and adults, in which OL, 
Scores were related to educational 
achievement, extracurricular and out-of- 
school activities, laboratory tests of level 
of aspiration, ratings of aspirational level, 
educational and vocational plans, cop. 
Bruence of vocational aspiration and at- 
tainment (as shown by satisfaction with 
unemployment), intelligence, апа social 
background and Status. In the followin 


pages an attempt is made to Synthesize 


ious studies 


22) 


these findings and to draw some ш 
sions as to the meaning and use of the 
OL scale of Strong's Blank. 


Occupational Interest Level and Indices 
of Drive 

Educational achievement. When intel- 

ligence is held constant, there is no S18- 

nificant relationship between the OL 

scores of high-school students and their 

grades, as shown in studies by Ostrom 


(43) and by Handelsman (27). Although. 


the latter investigator found a clearly sig- 
nificant and moderately high HIR E 
lation before intelligence was partiallec 
out, this relationship shrank to insignifi- 
cance once mental ability was controlled. 

At the college level, carlier studies by 
Kendall (35) and by Ostrom (42) have 
reported findings which lead the present 
Writer to conclude that the relationship 
between occupational interest level and 
achievement in college is very slight. It 
was only when Ostrom compared ithe 
honor-point ratios of High-OL and High- 
IQ students with those or five other pos 
sible combinations of OL scores апа 1Q’s 
that clearly significant differences in ges 
lege achievement were found. Working 
With graduate Students of business 
Strong (49) found no significant differ- 
ences in occupational interest level be 
tween high and low achieving groups. _ 

In the case of unemployed adults, Bat 
nett has reported a low but possibly 519" 
nificant correlation (Р =.05) аше 
occupational interest level and amount © 
education, which can also be largely €* 
Plained by the correlation of both © 
these with intelligence, 


А 


THE OCCUPATIONAL 
From the above data it seems necessary 
to conclude that there may be a very 
slight relationship between occupational 
interest level (as measured by Strong's 
Vocational Interest Blank) and educa- 
tional achievement. This relationship is, 
however, not clear enough to justify con- 
cluding that occupational interest level is 
related to motivation to achieve. Neither 
is the relationship close enough to war- 
rant using the scale as an educational 
counseling or selection instrument. 


it Extracurricular and out-of-school activ- 
ies. 


i Another possible way in which mo- 
tivation to achieve or to lead might man- 
ifest itself is in the relatively free activi- 
ties of school and community life. Han- 
„тап found what might have been а 
Significant but slight relationship be- 
tween occupational interest level and 
P a ekip and office-holding in school 
бег Rs in one of the high schools, but 
Бо] яв other. Stewart's group of high- 
Showe boys from homes of skilled fathers 
d a relationship like that of Han- 
delsman's first group when participation 
in in-school activities was analyzed, but 
ү E. чеп occupational interest level 
ОБЗ ated to school office-holding, or to 
fine UM activities, including part 
did E On the other hand, Stewart 
Pom that the boys who engaged in 
the pm types of occupations during 
summer tended to have higher OL 

Scores, 
к results suggest that there is some 
tional єў for persons with high occupa- 
School чиеге: levels to seek outlets in 
Mix te and to use their summer 
trainin s for earning, orientation, OT 
of b "xa although they show no evidence 
to be 8 inclined to hold school offices, 
Me c in organizations outside of 
Schoo] nor to work part time while in 
(the last two aré probably less re- 
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warding psychologically and 'socially). 
This might be characterized as a middle- 
class pattern. In the case of Stewart's sons 
of skilled workers, it raises a question as 
to whether we have demonstrated a mo- 
tivation to rise above the way of life ef 
the paternal socioeconomic level, or sim- 
ply the transmittal of a different way of 
life to the son by influences other than 
the father. As Stewart found a significant 
relationship between occupational inter- 
est level and the socioeconomic level of 
the mother’s family among these sons of 
skilled workers, it seems probable that 
the mother has transmitted to the son 
values from a cultural level different 
from that of the father. Whether the in- 
terest in middle-class activities and the ac- 
ceptance of middle-class values which re- 
sult in participation in school activities 
8 eetting summer jobs is the result 
fssive acceptance of a way of life 
Ok, есе of unusual motivation is not 
made tlear by the data. 

We are probably justified in conclud- 
interest level is 


ing that occupational 
slightly related to the use of school and 
summer work opportunities in ways 
which contribute to the attainment of 
status and to the preservation of other 
middle-class values. Taken alone, this re- 
lationship is, however, so slight as to pro- 
vide little basis for using the OL scale 
of Strong's Blank in counseling or selec- 
tion. 

Ratings of drive. In a study reported 
by Ostrom (43), students in the last year 
of high school were rated for drive by 
their teachers, their fellow students, and 
by the investigator after an interview. 
These judgments were based on the be- 
havior of the students in the classroom, 
in extracurricular activities, and in a va- 
riety of other life situations. Ostrom 
found that all of these ratings were cor- 
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related with scores on the OL scale of 
Strong’s Blank, and concluded that occu- 
pational interest level is a measure of 
motivation. He did not, however, allow 
for the fact that students from higher so- 
cioeconomic levels participate in school 
work and activities more than do those 
of lower socioeconomic levels, and that, 
as Hollingshead has shown (30), boys 
and girls from lower levels who want to 
participate often do not do so because 
they feel that they are discriminated 
against. Ostrom’s results could therefore 
be spurious. 

Our results tend to agree with Os- 
trom’s, but show a much lower and much 
less clear-cut relationship. Handelsman, 
we have seen, found that teachers’ rat- 
ings of pupil motivation had correlations 
of .23 and .25 with OL Scores, significant 
at the .o5 level, whereas in only ye. of 
his two groups were student self 
related to occupational interest ]c 

In view of Hollingshead's (30) fittings 
concerning teachers’ attitudes toward 
lower-class children, it js quite possible 
that the low Positive relationship which 
seems to exist between teacher ratings of 
motivation and Occupational interest 
level is the result of а tendency on the 
part of teachers to Tate boys according to 
the extent of agreement between the boys’ 
apparent values and their own middle- 
class values, If 50, Ostrom’s and Handels- 
man’s findings on ratings (whether by 
teachers, peers, or the investigator) and 
OL may only indicate that the boys 
whose interests are most like those of the 
middle-class Majority in high school win 
the Most social approval. If so, then oc- 
cupational interest level Scores could be 
considered measures of status rather than 
of drive, In using them as measures of 
motivation or drive on the basis of these 
findings one would therefore need to 


make assumptions the validity of which 
is open to question. m 

Laboratory measures of aspiration 
level. Handelsman's study shows that 
there is no relationship between stand- 
ard laboratory tests of aspiration level 
and occupational interest level, Indeed, 
his findings appear to demonstrate that 
Frank’s conclusion that level of „жей 
tion is a fairly stable characteristic of per 
sonality must not be applied too broadly, 
for there is no relationship between the 
two laboratory measures of aspiration 
level used by Handelsman and the бшен 
more nearly lifelike, measures which he 
used. By contrast, these other (non 
laboratory) measures did in some ur 
stances yield some low but positive inter- 
correlations, 

Educational and vocational plans. The 
nature of a student's plans for furthet 
education and subsequent vocation may 
be indices of level of aspiration which 
are more lifelike than those provided by 
the traditional laboratory experiments 
in aspiration level. Stewart has shown 
that Occupational interest level is related 
to high-school seniors’ plans for further 
education or work immediately after 
finishing high school, when paternal Of 
cupational level is held constant. Again, 
however, a positive finding must be quali- 
fied in view of the fact that Stewart found 
Significant relationships between occupa- 
tional level of m 
OL scores: 
whose moth 
economic h 


aternal grandparents and 
as sons of skilled workmen 
ers come from superior socio- 
ackgrounds tend to have a 
ests characteristic of higher occupationa 
levels, Perhaps they acquire also from 
their mothers a more positive чиш. 
of Post-high-school education and M 
white-collar jobs than js typical of boys 
whose mothers as well as fathers come 
from skilled or semiskilled backgrounds. 


TM; 


n 
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Seen uu speaking, occupational 
imm а chi a measure of similarity of 
economic ri of men ata given socio- 
motivatior cet е ee fader of 
1 to rise to higher social levels, 
other evidence must be found to that 
effect. 
ine is further complicated by 
tween ihn ге found no relation be- 
long-ran ong aoe interest level and 
ат. dia | айа болай plans. It may be 
these Rohre. vocational plans of 
there is aine 1001 Seniors are unrealistic; 
other ee a evidence to this effect for 
disparities үз о literature (45), and 
пк. ерден: aspirations and ех- 
"enint Te greater at the lower socio- 
this is so y than at the higher. M 
Criterion "ее data cannot provide a 
E OL scale. _ 
еен Reihen. i! he first two 
Stores oo te of the relationship benveen 
cational ер scale of Strong’s Vo- 
Strong resi Blank were made by 
Service ine (49). In a study of Forest 
Were bis ie the higher job levels 
вид ©] acterized by significantly higher 
relative mes es, which resulted from the 
tional es. of men with low occupa- 
Broups, F e levels in the administrative 
"Inemplo esempi when a group of 
cent Eu men were studied, 25 per 
interests ik ound to have occupational 
Skilled w E fhiosan unskilled and semi- 
viewed p я These findings were 
Cupational Strong as suggesting that ос 
tive of 4 хасин level might be indica- 
бнт to achieve status. 
4 though bip studied unemployed mer 
а boom à us subjects Sexe. tested during 
Sion, "d mer and Strong's in a depres- 
гоц Каз. chronically unemployed 
as су, the same average OL score 
Propriatel s; his nonchronic group ap- 
y scored about one-half sigma 


higher. Most important of all, strikingly 
high negative correlations between oc- 
cupational interest level and satisfaction 
with being unemployed were found for 
both groups (—.73 and —.68), and these 
were not lowered when intelligence was 
held constant. Taken as they stand, these 
results appear to offer a clear-cut con- 
firmation of the hypothesis that occupa- 
tional interest level as measured by 
Strong’s Blank is an index of drive: men 
who are satisfied with being unemployed 
tend to make low OL scores, while those 
who are dissatisfied with their lowly status 
tend to make high scores. 

But if occupational interest level is 
indicative of drive, why have these nor- 
mally intelligent, normally educated, and 
economically favored men (witness the 
Otis scores, educational levels attained, 


andá imed parental occupations) not 

r : ? Why ar any 
Rta! ore successful? W hy are the many 
hig. "s who are dissatisfied with their 


status“tnemployed and dependent in a 
period of labor shortages? In some in- 
stances (or perhaps many) still other fac- 
tors may be related to their being un- 
employed: physical handicaps were ruled 
out by the sampling methods, but per- 
sonality maladjustments are an obvious 
possibility. 

But Barnett reports some other find- 
ings which bear on this problem. Where- 
as parental occupation was not related to 
occupational interest level in his subjects, 
parental occupation was negatively re- 
lated to being satisfied with unemploy- 
ment. In other words, although there is 
no relation (in this group) between 
father's occupation. and son's occupa- 
tional interest level, both of these factors 
are significantly and negatively related 
to being satisfied with unemployment. 
These findings suggest that the OL scale 
measures what it was constructed to meas- 
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ure: the socioeconomic level at which a 
person's interests would place him. Men 
who are unemployed are unable finan- 
cially &o satisfy the interests they have 
developed in childhood and adolescence; 
the higher the social scale placement of 
their interests the less able they are to 
satisfy these interests when unemployed 
and the more dissatisfied they are with 
their unemployed status, Similarly, men 
whose fathers were employed at relatively 
high socioeconomic levels find being un- 
employed more in conflict with their 
socially acquired values than do men 
whose fathers were from lower occupa- 
tional levels and who therefore were 
more inclined to consider some unem- 
ployment inevitable. For these reasons 
Occupational interest level is related to 
unemployment satisfaction in the same 
way as is parental occupational le 
If this is indeed the nature of } : 
lationships, there is no need to pc 
that motivation or drive is invoivéd in 
Occupational interest level, Occupational 
interest level may be static in nature, 
simply an indication of the status level 
of interests, or it may be dynamic in the 
sense of moving one to do somethin 
about finding appropriate outlets for 
his interests, While it is true that data 
Such as Strong's follow-up studies of 


Stanford students (49) suggest that there 
is something dynamic in 


“ate 


interests 
(Strong’s studies reveal a tendency to 
enter occupations in which interest js 


high or, if a low- 
entered, to shift to 
est), the dynamics 
those of fields, 
it is in level th 
context. 

We must conclude, then, that it has 
not as yet been demonstrated 
tional interest level is a me 
tivation to achieve or toa 


interest Occupation js 
fields of greater inter- 

in this instance are 
rather than of levels. And 
at we are interested in this 


that оссира- 
asure of mo- 
Cquire status, 


It is, at least, a measure of similarity of 
interests to those of men at various socio- 
economic levels (its method of construc- 
tion should guarantee this). The Forest 
Service administrators studied by Strong 
may have been attracted to their higher- 
level jobs by the administrative пине 
of the work rather Шап by desire for 
status, and the forest rangers may wr 
remained rangers not because they lacked 
ambition but because they liked a 
ranger's work more than management. 
True, the OL scale may yet be shown to 
measure drive, and we have not demon- 
strated that it does not do so. But we 
have shown that all available evidence 
concerning the OL scale can parsimonr 
ously be interpreted in terms of similarity 
of interest. It is not unreasonable to ex: 
pect a measure of similarity of interest 
to measure only Similarity of interest. 
Neither is it surprising to find that fields 
of interest have a dynamic which may 
not be shared by levels of interest, when 
the instrument used in measuring them 
both was originally designed to assess 
the former, . 

In counseling and selection, then, 1t 
would appear justifiable to use the OL 
scale in order to find out whether a pe! 
son has interests which will find appro 
priate outlets at a given occupational 
level, or in order to ascertain at which ОС" 
cupational level he js most likely to find 
appropriate outlets for his interests. But 
So far as we now know level of interests 
is likely to be less important to adjust 
ment than is employment in a field a 
work which provides appropriate outlet 
for types of interests, 


Occupational Interest Level and 
Personal Data 
5 - re- 
The data and conclusions so far A 
viewed have had to do with ы 
between Occupational interest level а 


— ied 
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various indices of drive, whether tested, 
rated, or manifested in school, leisure- 
time, or vocational activities. However, 
in order to understand the meaning of 
Occupational interest level we must also 
know something of its origins, as deduced 
from its relationships with various types 
of personal and family data. 
Intelligence. In the original studies of 
Ds n Strong (49) found no re- 
ecc etween scores on that scale and 
жы ә test scores. Our investigations 
ian the original work, with cor- 

Ee s ranging from .20 to .42, both 
E being for Handelsman's high- 
Ой dar and seniors; Stewart's high- 
ur estat ai all of them sons of skilled 

orxmen, yielded a correlation of .25 
(significant at the 1 per cent level), and 
ee е an r of .28. It therefore 
Ош oo to conclude that in a 
^ ame ae there isa relationship be- 
bere вт interest level and in- 
а little ce. One must understand at least 

© in order to be interested. 

Social background. No previous investi- 
xr ass dealt with this topic, on 
Bj vif] pup gathered a little data and 
Sir cae Stewart's study focused. Bar- 
tion in ated OL scores to paternal occupa- 
Loon socially, educationally, and intel- 
ployed y heterogeneous group of unem- 
the к се, finding no relationship in 

ut si ires group (14) and a very low 

the Жоош negative correlation 1 
prisin chronic (—.24). These are sur 
Bare ев as one might have antici- 
Would 0g the social level of the father 
social aa prime determinant of the 
ests. How of the son’s vocational inter- 
field of wever; the correlation between 
been AE AR in father and son has 

h the n to be only .30 (6, 49). | 
а positive other hand, Stewart did find 
ween th and significant relationship be- 
4 е occupational interest level of 


his skilled workmen’s sons and the oc- 
cupational levels of both maternal grand- 
parents. As paternal occupation was held 
constant in this study we may not con- 
clude that the role of the mother is more 
important than that of the father, but 
the finding does fit in with the widely 
held idea that women are the carriers of 
culture. It suggests that when the 
mother’s background is superior or in- 
ferior to that of the father, the interests 
and values which typify her background 
will to some extent be transmitted by her 
to the son. 

Only one other item of family back- 
ground was found to be related to occu- 
pational interest level: family religion. 
Sons of mixed Protestant-Catholic mar- 
riages tended, in Stewart’s sample, to 
make higher OL scores than others, 
Protzitants ranked next, and Catholics 
Kp, Wthe difference between the last 
eM ups was not statistically signifi- 
cant'znd there were too few Jews for 
comparisons). Perhaps willingness to 
marry across religious lines is the result 
of a social mobility which manifests itself 
in higher vocational aspirations in the 
children of such marriages, but it may 
also be that this freedom from tradition ' 
is associated with interests and values 
which affect the upbringing of the chil- 
dren and manifest themselves in the chil- 
dren's interests. Perhaps only the more 
highly educated are likely to feel free 
to marry across religious lines. 

Other family data analyzed by Stewart 
included the occupations of mother and 
siblings, the educational attainments of 
other members of the family, parental 
community activities, parental social mo- 
bility as indicated by attitudes toward 
the neighborhood in which they live and 
by the social levels of people associated 
with, and similar factors which might be 
expected to provide models of attain- 
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ment and aspiration for maturing chil- 
dren. None of these, however, was related 
to occupational interest level, 

These findings are not easily synthe- 
sized or rationalized. If we explain away 
the lack of significance of the mother’s 
occupation on the grounds that women’s 
occupations mean little in terms of status 
because of limitations on their employ- 
ment (hardly true when one examines 
the social backgrounds of teachers, nurses, 
stenographers, sales clerks, factory opera- 
tives, and domestics, as shown by Hol- 
lingshead), we must then explain the 
Statistically significant relationship with 
the maternal grandmother's occupation, 
And why is occupation more important 
than education? It might be because the 
former clearly provides a Status label, 
whereas the latter does not—but then the 
occupations of the most successful relative 
and of siblings should be import, 
occupational interest level, 
are not, t 

The most striking and clear-cu 
ing concerning family background and 
occupational interest level is the lack of 
relationship between the two. Although 
we are given a Suggestion that perhaps 
the social level of the mother plays a 
part in determining the level of the son’s 
occupational interests, this is not a con- 
clusion of which we can be sure in view 
of seemingly contradictory findings. 
What, then, are the origins of interest, 


A 
t find- 


correspond? 
Perhaps field or type of interest is the 
important factor, the level factor being 
important only in that it reflects the 
level at which the individual's type of 
interest can find outlets, Clerks, skilled 
workmen, and semiskilled laborers do 


not manage enterprises, hence à person 


interested in managerial activities. and 
able to do so finds outlets in administra- 
tive work; ipso facto, he has interests like 
those of mn at high occupational маа 
Engineers do пог usually work directly 
with tools and materials, therefore a man 
with technical interests who likes to work 
directly with materials has, by virtue of 
the way in which work is now organized, 
interests like those of skilled workmen. 
Empirical Support for this hypothesis 1s 
reported in Table 6. 

In Table 6 data from Strong (49) have 
been reworked to show the mean НІ 
Scores of the various types of уш 
Groups 1 through 8 represent fields 9 
work and to a lesser extent, perhaps, 
levels, while Groups 9 and 10 are a ш 
nearly equal mixture of field and level. 
As the mean ОГ, scores show, persons 
who have literary interests are ipso facto 
likely to have a high occupational ишеге 
level. Similarly, those who are interested 
in skilled work with tools are ipso e 
likely to be placed at a low occupationa 
level. 

If this is Correct, it may be necessary tO 
seek the origins of occupational шеге 
levels in the origins of types or fields o 
interests rather than in status or prestige 
drives. The origins of types of interests 
have been dealt with at length elsewhere 
(53, Ch. 16), 


General Conclusions 


In conclusion, 
strated th, 
Level sca 


it has been demon 
at the Occupational (Interest) 
le of Strong's Vocational Inter 
est Blank is not related to family Pon 
ground, although the socioeconomic leve 
of the mother's family and the freedom 
from binding traditions represented by 
willingness to marry across religious ine 
may have some bearing on ene i 
interest leve]. Occupational interest leve 


—— M ————— Бу. 
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TABLE 6 


OccuraTIoxAL FIELD AND OCCUPATIONAL LEVEL 
(Data reworked from Strong (49), Tables 50, 53, and 87) 


Е ези 
Field or Occupational Occupational Level 
Family, N r, Field X Level! 
Family M SD , el 
Bs President, Mfg. Concern 169 63.4 7.2 63 
2. Prof.: Literary-Legal 628 63.2 6.7 .53* 
3. Biological Sci. 764 60.0 7.5 =, Eg 
4 Physical Sci. 1083 60.9 6.7 —.22* 
e . Social Welfare 882 58.9 7.2 —.17* 
‚ Business Contact | 786 62.0 7:5 43* 
7. Business Detail 1128 57-7 7.4 —114* 
8. Skilled Ess, 48.3 8.0 a= 
9. Semiskilled - | 45-9 8.6 "s 
, X0. Unskilled — 44-4 8.7 = 
* 
осецорсагзопіац r's for each occupation in the family in question averaged by = transformation to yield an average r for the 


a з in ea i 
his each family. 


TT 3 
Scale, Tis athe correlation between scores on the occupational scale (representing fiel 
populations in each case include a wide range of occupational field scores, $! 


Tange, 


а | a reflection of the father's 
n. wapat level. It seems most likely 
tion a и interest level is a func- 
Various a occupational levels at which 
tanie a or types of interests can 
of abilit : песе, апа hence indirectly 
cial мага aptitudes, personality, and so- 
aluation, 

да bation interest level is not 
adito x clearly related to educational 
tent ien It is slightly related to ex- 
activiti participation of extracurricular 
the БЕ. Eee summer employment on 
Not to м high-school students, although 
Suggest s hool office-holding; these facts 
Values д hat OL scores reflect middle-class 
est feet D interests. Occupational inter- 
Of drive is somewhat related to ratings 
observer made by teachers, peers, and 
festation , but this may simply be a mani- 
People t of the way in which middle-class 
Values ici to approve of those whose 
related ea resemble their own. It is not 
aspiration, aboratory measures of level of 
schoo] sc It is related to immediate post- 
this ud яп ые high-school students, but 

y reflect the inherent relation be- 


d of interest) and scores on the OL 
kewed toward the upper end of the 


tween field of interest and level, more 
than the effect of occupational level aspi- 
rations upon choice of field. Although the 
method of construction of the OL scale 
in a relationship between occupa- 
x interest level scores and occupa- 
tions: placement on the socioeconomic 
ladder, there is no evidence which would 
justify concluding that the OL scale, is 
a measure of drive to advance occupa- 
tionally: it is, however, clearly at least a 
measure of similarity of interests to those 
of men at various points of the socio- 
economic scale. The evidence now avail- 
able warrants interpreting the оссира- 
l score as a measure of status of 
interests: the OL score can indicate the 
socioeconomic level at which a person 
should be able to find outlets for his 
interests. The evidence does not warrant 
interpreting the OL score as a measure 
of drive: it has not been demonstrated 
that the OL score can or cannot indicate 
how much a person will exert himself 
to rise on the occupational ladder or 
to succeed in his field of activity. 


tional leve 


APPENDIX A 


UNEMPLOYMENT SATISFACTION SCALE 
Совром J. BARNETT (after Robert: Hoppock) 


- Choose the one of the following statements below that 
being unemployed. MARK IT WITH AN X. 

I hate it. 

— —— I dislike it. 

On the whole I don't like it. 

— —— lam indifferent to it. 

———. On the whole I like it. 

——— I like it a good deal. 

— —— [like it very much. 


Iam enthusiastic about it. 
——— I love it. 


A: t 
you think best tells your feelings abou 


; Я er 
- Mark an X in front of the statement below that best tells how you think you compare with oth 
unemployed people. 


— —— No one likes being unemployed better than I do. 
— — I like being unemployed much better than 


most o 
———— Ido not know how I com 


ther unemployed people. 


C. Mark an X in front of the statement ^ ow that tells HOW MUCH OF THE TIME you fcel 
SATISFIED with being unemployed. | - 
All of the time. | 
Most of the time. ”. 
A good deal of the time. 
About half of the time, 
Cex Occasionally, 
—— Seldom. 
. ——— Never, 


D. Mark an X in front of the statement below which best tells how you feel about 
unemployed condition, 


— I would give anything to stop being unemployed. 
—— I would take a job if T 


could find anything to do. 
——— I would take a job if it 


bettered my condition. 
-——— I would not want to sto; 


р being unemployed altogether, 
——— I cannot think of any 


changing your 


APPENDIX В 
STUDENT'S SELF RATING 


IRVING HANDELSMAN 


( 

( 

( ) I believe that I s 
( s 

( 


30 
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—— 
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APPENDIX С 
RATING OF LEVEL OF ASPIRATION 


4 
IRVING HANDELSMAN 


Student's. Name 


Please check the sentence which most describes this student: 

He sets high goals for himself, which he works hard to attain. 

He sets high goals for himsclf, which he does not work hard to attain. 
He sets average goals for himself, which he works hard to attain. 

He sets average goals for himself, which he does not work hard to attain. 
He sets no goals for himself. 


weve 


APPENDIX D 
BIOGRAPHICAL QUESTIONNAIRE 


LAWRENCE Н. STEWART 


TRE cco ko, say ОО mre аллаи анана ES Age e) ennt 
ЕЛШЕ А Grade «4. yes 
1. How many older brothers do you have)... ient Younger? eee án 
2. gt , : 
How many older sisters do you have? :---- NN HT Younger? «ee 
% pr any of the following statements that apply to, * 
( ) Ilive with my parents. pe 
( ) My parents are divorced and I live with one of them. 
( ) My father is dead. 
) My mother is dead. | ? 
) I live with foster parents (or guardian, grandparent, etc.); (fill in date) since 10... 
4. Father's (or foster father's stepfather's) job (for example: baker or carpenter: «tá 


Place of work (for example: flour mill or machine shop): 


DM -— Р 
Tother's job (for example: dressmaker or hansenii wee dante! 


P 
lace of work (if she works away from home): 


J М K SD SUPER 
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7. Most successful older sister's job: 


Place of work: 


10. Mother's father's job: 


Place of work: 


11. Mother's mother's job: 


Place of work: 


Just what does or did she do? 


12. Most successful relatives. job: 


Who is he or she (for example: cousin, uncle)? 


ON St шры, 


Just what does he or she do? 


13. Who is the person, living or dead, that you most admire (for example: aunt, local policeman, or 


ucc Ж ИНИ 
14; Your parents have usually considered that they belong to the following religious groups (check 
one in each column): 
Father Mother 
( 3 C6) Protestant 
6) Roman Catholic 
( 


i od 
) ( 3 Jewish 
) € 4 Other (ame) sese. 
) ( } |o GEL c ылы, 
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Your parents and their parents are of (check one in each column): 
Father Mother 
I 3 C») Old American stock (your parents and grandparents born in this country). 
kb 3 ( ) Northe-n European stock (English, Scotch, Irish, Scandinavian, German, 
etc.). 
C) q > Eastern European stock (Russian, Polish, Rumanian, Servian, Greek, 
Latvian, ctc.). 
C) €) Stock not indicated in the above groups. 
16. Your par Р 4 
Your parents were born in (check one in each column): 
Father Mother 
р ) ( ) the South. 
) C») the West. 
t ) ¢ 4 the Northeast. 
) ( ) the Midwest. 


7. Your family's friends are (check onc): 
y ) less well off financially than you are. 
) better off financially than you are. 
( ) about the same as you ате. 
. HOW far i i i i 
ow far do you believe cach of the following people went in school (place checks in the 
appropriate columns)? 


Grade | Entered |Finished | Entered | Finished | Still in Don't 
School HS. | HS. College | College | School Know 


Father 


Mother 
1 


MACHEN S: MOLT оаа ауан [lv cn ase еа е | +> nate t peni RR us ptm nr oe 


Most educated brother |... + emnt 


M 
Ost educated sister .. 


N 
[ew educated relative | 
9t mentioned above) | ' 


Wo 5 н 
9 is he (for example: uncle, cousin? 


19. Y, 
: e Parents are active in (check one in each column): 
as a Mother 
(€) ( ) no clubs or organizations. " 
( t one or two groups, generally just as a member. 
( ) C ә а number of organizations, just as à member. 
) ( 3 one or more organizations, often as an officer or leader. 


List 5 
the principal organizations for: 
Your father 


your 


mother 


зо, De 
? Your parents go to concerts (check one)? 
? 8 
( Never 
( ) Seldom 
Frequently 
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21. Your family lives in a (check one): М 
( ) private, one-family house which they own. 
( ) private, one-family house which they rent. 
( ) two- or three-unit house or apartment which they rent, 
( ) two- or three-unit house or apartment which they own: 


22. Your family feels that you (check one): 
(^ ) should live in a better neighborhood. 
( ) should live in a less expensive neighborhood. 


( ) are well located where you are at present and should continue the arrangement. 


ег ree 
23. Approximately how many books does your family have (count about 25 books for every thr 
feet of shelf)? 


rods. How many children's books 7. How many adults’ books? ....-- 


24. Does your family subscribe to any magazines? Yes 


No —____ И yes, list the magazines. 


25. Does your family own any automobiles? Yes. — No 


auto- 
———— If you own more than one a 
mobile give the following information for each of them. 


Se dece dst Bought new? Yes. — — No 
РОТОР Bought new? Yes ___ No. 


26. Do you have a telephone at home? Yes —— No 


пе? 
— If so, do you have a party line 
du. Ма. Private line? Yes No 


27. Do you have a typewriter at home? Yes fw No 
[Р 


28. Do you havea radio at home? Yes__, , 


29. Do you have a television set at home? zs 


32. In school you belong to (check one): 


("1 no organizations, 
( ) one or two organizations, 
( ) more than two organizations, 


(check one); 


) no office in any of the above organizations, 
an office in one or two of these Organizations, 
) an office in more than two of these Organizations, 


35. Outside of school you belong to (check one); 
(^ ) no organizations, 
( ) one or two organizations, 
(  ) more than two organizations, 


( 


— io — 
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37. Outside of school you hold (check one): 
( ) no office in any of the above organizations. 
( ) one or two offices in the above organizations. 
(..) more than two offices in t' ese organizations. 


38. Your closest friends are largely children of (check one): 
( ) skilled workers and foremen (machinists, carpenters, etc.). 
( ) proprietors and officials (managers, contractors, etc). 
(  ) unskilled workers (janitors, street cleaners, etc.). 
(у) semiskilled workers (filling station operators, lathe hands, etc.). 
( ) professional men and women (lawyers, doctors, teachers, etc.). 
(© ) clerks and salesmen (bookkcepers, cashiers, mail clerks, etc.). 


39. Check one of the following: 
(у) Ihave an allowance. E 
C) My family gives me what I need when I ask them for it. 
( ) Ihave no allowance. А 
| ) Tearn my own spending money for most of the smaller things I want. 


) Learn all my spending money. 


+ Do you usually work after school? Yes ——— No — 


For whom did you work (for example: grocer, baker, etc)? - 


: Do you usually work during the summer vacation? Yes 


D des, sibi ane yone TRE FOE nessun n opr 


For whom did you work (for example: grocer, ba, бе tc» - 


42. ^ : Anc 
Have you ever traveled considerable distances from: | 


13. Do You visit museums (check one)? 
( ) Never 
( ) Seldom 


) Frequently 


35 


If so, what was your last job? ........ 


igh school (check one)? 


CATION? `..... за чаан коа t 


44: What do you plan to do after you finish high school (check ener 
( ) Get a job. 
( ) Go to a business school. 
( ) Gotoa college or professional school. 
) Go to a technical institute. 
45: What do you think your parents would like you to do when'you Bons 
{ ) Get a job. 
( ) Go to a business school. 
( ) Gotoa college or professional school. 
К ) Go to a technical institute. 
‚ү . 7 ish your ed 
What kind of a job do you expect to get when you finish your e 
47. " /ear: rom now; 
7: What kind of а job do you think you are likely t° Dave ton ge Ea 
48. dult, what would you like to do? ... eret eette 


If you could have any job you wanted, as an а 
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WEAKNESS: 


I INTRODUCTION 


da purpose of this study is to exam- 
he dies мир чает. the view that 
bon. E involves a degree of dif- 
individu; eee what the maladjusted 
Society а AI as rcal and what his 
this «aas BS real. The investigation of 
tion of До has entailed the construc- 
iei наи for measuring per- 
social бааа sas Dbjective oF 
Блер а ny and an examination of the 
these E and predictive value of 

struments, 
" umi underlying the research 
Separate Те арня cannot be entirely 
асап a | rom memory, thought, and 
act as th Sis to a large extent individuals 
tive dior. perceive (3, p: 367). The adap- 
environme, of Ше individual toward his 
Тре arise out of the total con- 
{лгы 5 forces existing in the person- 
ble aspe гойт field. The overtly visi- 
Phone: of this configuration and the 

enal aspects (perception) are at 


its 
to к DEM wishes to express his appreciation 
their hel SR aS of his doctoral committee for 
ciation AU ut criticism and for the close asso- 
dore Paes with them: Professors Е. Theo- 
Ellis, He zu Florence Mateer, and Robert S. 
or Реб also indebted to Dr. Bruce т. Jewell 
o Кот кас the exacting task of ranking the 
© Superi ach records in order of adjustment, 
оп Ыш найы ONS Ie Carike of the Pat- 
freedom | Hospital, Patton, California, for the 
and to d in the use of hospital facilities, 
Hospital 4 iam О. Walcott of the Patton State 
Ness at sychology Department for his helpful- 
Many times. 


the instant of action in perfect relation- 
ship since they are but different ways 
of viewing the same events. From this 
point of view, therefore, behavior at odds 
with the demands of the objective en- 
vironment coexists with perceptions that 
ignore, distort, or circumvent the real 
world as most people understand it. 


А. DEFINITION OF TERMS 

" лей in terms of the procedures of 
the ‘A “dy, reality denotes those objec- 
tively apparent, verifiable relationships 
which are generally accepted as self-evi- 
dent. Strength of the reality contact de- 
notes, in turn, the degree to which an 
individual’s perceptions conform to this 
normative standard. Strong reality con- 
tact is evident in any instance of ac- 
curate perception of objective stimuli 
or in instances of objectively oriented be- 
havior. Weakness of the reality contact 
may be inferred when individuals are un- 
able to perceive objective stimuli accu- 
y—when, despite deliberate attempts 
at objectivity, experience and behavior 
are organized with reference to subjective 
factors and in disregard of objective fact. 
Experience, of course, is always subjec- 
tive, and no weakness of reality contact 
is implied in the investing of objects 
with individual significance. Good reality 
contact merely demands that the raw 
facts and intractable relations of objec- 


tive data be not ignored. 


É 


ratel 
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It is assumed that the real world may 
be accurately experienced and that the 
level of accuracy of one’s experience of 
the real world may be quantitatively de- 
scribed. Bold as such assumptions may 
appear, they are nothing more than corol- 
laries to the definition of reality which 
is employed. Whereas absolute reality, 
if such exists, is nonverifiable, the reality 
dealt with is a matter of statistical 
averages and can be known. Objective 
reality becomes a reference point, and a 
'definable distance exists between this 
reference point and the point represent- 
ing personal reality. The shorter this 
distance, the greater the strength of the 
Teality contact, Reality contact is held to 
bea quantitative feature of all behavior, 
cutting across all qualitative dimensions; 
and, as such, it may furnish a needed 
conceptual tool for assessing the deeree 


of pathology in various behavior 
orders, 


B. THE Рковікм AND METHOD 


The directing hypothesis Motivating 


the present study may be Stated as fol- 
lows: 


Specific subquestions derived from this 
hypothesis have been put to experimental 
test. These are as follows: 


1. Are the reliabilities of the instru- 


contact? 
2. Are the validi 
sufficient to warra 
of their value as 
contact? 


А : Š 
3. Are the measures obtained by medn 
a cri п 

of the instruments related to a criterio 


of the geCeral efficiency of the personality 


adjustment? 


svchiatric 
Rorschach results and psychiat 


i -teri the 
diagnoses were used as criteria of 


level of personality adjustment. To а 
Sure an adequate test of the oe 
there were two groups of subjects, а 
опе group composed of paranoid т 
phrenics who may be expected to se 
reality contact weakness in clear om 
the other group consisting of normal = 
psychoneurotic subjects. The gie 
group, which is called the inne 
rotic group, was made as heterogeneous " 
Possible with respect to level of le 
ment. The object of this ipao Sq 
was the creation of an experimental yd 
ation that might reveal a relation t- 
tween test scores and the level of mage 
ment within the normal-neurotic ae 
Analysis of results included ay ЕТ 
comparison, analysis оп the level of ee 
Sroups combined, and analysis on t 
level of the normal-neurotic group. 


C. Sunjecrs 


1. The Normal-Neurotic Group 


The Subjects comprising the pm 
neurotic group were 30 in number sis 
conformed to the following ape 

1. Young adults of both sexes W! 
ages from 29 to 40, :4] as 

2. Superior intellectual potential a 
evidenced by vocational status, а 
Попа] attainment, or the production, h 
one or more Rorschach responses of hig 
form level, as 

3. Persons who as a group pae 
heterogeneous as possible in the efficie 
of Personality adjustment, tic 

4. The absence of clear-cut eee 
behavior at the time of testing or at а 
time in the individual's past. 


. 
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The members of the normal-neurotic 
group were relatively homogeneous in 


. Social and economic background and in 


educational level. Fifteen of the subjects 
were college graduates and all but two 


of the remaining had attended college. 


- Adjustment ratings made from the Ror- 


se 5 Schach by means of the Munroe revised 


. Check list (7) indicated that the attempt 
to secure heterogeneity on the adjust- 
ment dimension was successful. 


2. The Psychotic Group 

The subjects comprising the psychotic 
group were 30 in number and conformed 
to the following criteria: 

1. Young adults of both sexes with 
ages from 20 to 40. 

?. Persons who were institutionalized 
and had been diagnosed as paranoid 
schizophrenics. 

Е а perior intellectual potential as 
is ced by educational attainment, by 
Prepsychotic vocational status, or by the 
Production of one or more Rorschach 
Tesponses of high form level. 
"e all instances there was a history of 
arre behavior including severe depar- 
"ys from reality demands. The severity 
mu symptoms at the time of testing 
К considerably among the зо sub- 
Shey However, with the exception of 
Patient, none of the subjects was 
oe well enough to be under 

. eration for discharge from the hos- 
Pital. 

Although all members of the psychotic 
P had been diagnosed as paranoid 
шш ина many of the subjects pre- 
«os: Py. symptoms and several—be- 
бе. ү personality changes since the 
ка о diagnosis—fit more closely into 
A Other entity. Since paranoid sub- 

were selected solely for the reason 
; о tend to be less deteriorated and 
Ore easier to test, it was not neces- 
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sary to verify diagnoses. It was essential 
merely that the presence of psychosis be 
established, and this, of course, was easy 
to do. 


D. THE INSTRUMENTS AND THEIR MANNER 
OF ADMINISTRATION 


Six tests were administered in three 
different sessions of approximately one to 
two hours’ duration separated by an 
interval of at least one day. New tests 
which were devised for the experiment 
are reproduced in the original disserta- 
tion (5). The sequence of testing was as 


follows: 
First session: Rorschach 
Digit Test, first adminis- 
tration 


Second session: Information Test 
Action Picture Test 
Thx, session: Multiple Choice Stories 
E Test 
Picture Description Test 
Digit Test, second ad- 
ministration 


n 


1. The Rorschach 
The Rorschach was used, as described 
below (II, A), as a basis for securing the 
criterion of adjustment. It was adminis- 
tered according to the procedures de- 
veloped by Klopfer and Kelley (4). 


2. The Digit Test 


The purpose of the Digit Test was to 
obtain a measure of the perception of the 
self object by requiring subjects to report 
upon the accuracy of their own perfor- 
mances. The Digit Test made use of the 
stimulus material of the digits subtest of 
the Wechsler-Bellevue Adult Intelligence 
Scale (9, p. 177). Only one trial was 
given at each level of difficulty instead 
of the two trials provided by Wechsler. 
After repeating each digit serics, the sub- 
ject was asked to report upon the ac- 
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curacy of his own performance. The pre- 
liminary instructions were as follows: 

I am going to say some numbers and when 
I am through I want you to repeat them in 
the same order as I have said them. After you 
have repeated the numbers, I shall ask whether 
you have repeated them correctly or incorrectly. 


Or perhaps you will be doubtful. You will 
merely say correct, incorrect, or doubtful. 


Before presenting each digit series 
forward the experimenter said: 


Listen carefully and be sure to say the num- 
bers in the same order as I do. 


After the subject had repeated each 
digit series he was asked: 


Did you say them correctly, incorrectly, or 
are you doubtful? 

Before presenting the digits backwards, 
the experimenter explained as follows: 
Б to say some numbers and 


when I am through, I want you to say them 
backwards. For example, if I say 2, 8, 


"ou 
will say 3, 8, 2. As before, I shall ask her 
you said the numbers correctly, incorr y, or 


whether you are doubtful. 


Before presenting each digit series 
backwards, the experimenter said: 


Listen carefull 


y and be sure to say the num- 
bers backwards, 


As before, after 
ject was asked to 
sponse was correct 
he was doubtful, 


each response, the sub- 
report whether his re- 
, incorrect, or whether 


3. The Information Test 


ation Test 
at disclosed 


y of his own beliefs 
to the standard of objective fact, The 


test aimed therefore to make manifest 
in a limited sense, the manner of perceiy- 
ing the self object and the congruity of 


this view of self with a more objective 
view. 

The Information Test consisted of 50 
items of the multiple-choice type with 
four possible choices in each case. In 
devising the test an effort was made to pi 
cure questions from a wide variety 9 
subject fields and to eliminate in this woy 
the possible influence of specialized 
knowledge and abilities. Questions were 
chosen which were judged to be ic 
to and yet difficult for the average colleg 
graduate. " 

The preliminary instructions to t 
subject were as follows: 


This is a test to show how much inm 
tion you know. But it also has another р ow. 
It shows how aware you are of what pm c 
and what you do not know. Some peop ont. 
lieve they know things when they really Не ЕЕ 
In taking this test you are supposed to P nel 
only those questions that you are absolu not 
Sure you know. Do not guess, If you ы 
positive about the answer to a question, ? hed 
that question blank, After you are all finis". 


\ 2 by 
you will have a chance to raise your ae Re- 
guessing at the questions you left blan ` сап, 
member, make 


as good a score as you 
but don't guess, 
The exact wording of the instruction? 
varied somewhat from subject to subj 
but the substance was repeated and ок! 
Phasized until there was no doubt in 
the subject understood that he was en 
to guess. After the subject responded 
all those items whose answers hé Wa 
Positive he knew, he was furnished with # 
red pencil and was asked to fill in all i 
remaining blanks by making the з 
8uesses he could, On the completed tc 


: Б г in 
blank all items were marked, either 
black or in red. 


z ost 
4. The Multiple Choice Stories Tes 


. con- 

The Multiple Choice Stories Test ae 

sisted of 13 uncompleted stories, per 
Of which was followed by two poss! 


š . Pes an 
conclusions, The unfinished stories 
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their conclusions were mimeographed in 
such a way that the subject's choice of 
conclusion could be indicated bf a check. 
One of the two conclusions was more 
probable of occurrence and more con- 
Sistent with the facts given. Although the 
test does not directly measure the percep- 
поп of reality, its inclusion was based 
upon the hypothesis that one’s method of 
organizing reality is revealed by the di- 
mension of the story to which he re- 
sponds, i 
The experimenter is indebted to Wolf- 
[e for the idea of the Multiple 
Ў hoice Stories Test (10). Four of the 
Stories used have the same plots as stories 
of Wolfenstein although the exact word- 
са the same. Nine additional stor- 
е composed by the experimenter. 
"s E — of the test administra- 
iater subject was handed the test 
al and permitted to examine it for 


a fe 7 
"Ww moments. Then he was instructed 
as follows: 


Thi " 
P s test is made up of a number of very 
dnd [ош Each story is unfinished, and two 
you ple ways of ending the story are given. 
endi ure to read each story and cach of the 
of Any which follow it. Then decide which 
no sura endings you like better. There are 
your ght or wrong answers, Just be guided by 
T Own likes and dislikes. 
After ; s 
th fter a subject had checked all stories, 
er Е: ; . А 
of : Was an inquiry, the main purpose 
whi : : 
we ^s was to determine the basis upon 
l . 
ch the choice was made for each story. 


es > z 
| ponses to the inquiry were recorded 
Verbatim, 


= 5. The Action Picture Test 
fers tede of the Action Picture 
cards азр of 11 eight by five inch 
ina dis 1 сага having upon ita simple 
йзге ab ne of a human figure in a 
OE ди a muscular strain or in the midst 
pee IPIE act. Those pictures 

g action in the direction of a 


goal were drawn in such a way that suc- 
cessful achievement of the goal was un- 
likely. 

The subject was furnished with ordi- 
nary typing paper and a medium sharp 
lead pencil. He was given the first card 
and instructed as follows: 

This is a test to show how accurately you 
can draw what you observe. Try to copy each 
picture exactly as it is as nearly as you are 
able. But do not use a straight edge nor 
measure the pictures in any way. There will 
be 11 pictures in all. You may use as much 
paper as you wish. There is no time limit. 

'The factors of interest were two: The 
total amount of discrepancy between the 
stimulus pictures and the reproductions, 
and the degree to which the reproduced 
drawings reduced the muscular tension 
of the figures or made the successful com- 
pletion of the act more certain. These 
tendencies toward reduction of muscular 
ten: and movement toward the goal 
were Called closure tendencies. A hy- 
pothesis under consideration was that 
such instances of closure are indicators 
of a factor of empathetic response. By 
empathetic response is meant participa- 
tion in the emotions or actions of another 
to the extent of actually feeling the emo- 
tions and actually contributing one’s 
own motor effort to the efforts of another. 
Should closure tendencies be indicative 
of empathetic response, it is logical to as- 
sume that they correspond to dissociated 
and uncontrolled empathy. This follows 
from the nature of the instructions which 
direct the subject to copy the figures ex- 
actly as they are. 


6. The Picture Description Test 
The Picture Description Test was de- 
vised in an effort to examine the degree 
to which the verbal report of a presented 
visual stimulus diverges from the objec- 
tive characteristics of the stimulus. Ten 
pictures obtained from magazines and 
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mounted on stiff Manila paper 9 X 12 
inches in size were used as stimuli. The 
pictures were highly structured in the 
sense of representing familiar objects and 
people in meaningful relationships. Each 
picture was placed upon a standard and 
exposed to the subject's view for a three- 
second interval; after a ten-second wait- 
ing period, the subject described the pic- 
ture as precisely and completely as 
possible, 

The instructions were as follows: 


1 am going to show 
one at a time. Each pic 
three seconds, After th 
and the picture js re 
ten-second period to 


some pictures to you, 
ture will be shown for 
€ three seconds are up 
moved, you will have a 
think about the Picture, 
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Then I will ask you to describe it to me. This 
will show your ability in observation. The pe 
you remember the better your score will А 
But Бе swe to be completely accurate. Do n 
interpret the picture or add things that а have 
actually shown. Just describe what үөн. bce 
scen and see as much as you can. Remem E 
three seconds, then wait ten seconds, T 
me everything you remember. Just Deloss E: 
show a picture, I shall Say, "Ready," so UY 
you know it is coming, the 
The card to be shown was placed on nd 
standard and covered with another card. е 
experimenter said, “Ready,” and хётдуёб, as 
covering card for a period of three secon des 
measured by a stop watch, This rough p a 
cedure resulted in an actual exposure ume d 
fraction of a Second more or less than dem 
Seconds, but the amount of error шшш 
is not large enough to require any more pre 
method of governing the exposure time. 


П. SCORING METHODS 


A. THE RORSCHACH (3 


E QUANTITATIVE measure which 
served as the criterion of the degree 
of adjustment was derived from Ror- 
schach results, but the criterion used for 
analysis on the level of the normal-neu- 
rotic group was differently obtained than 
the criterion used for analysis on the 
level of both groups combined. 


1. The Munroe Check List Rating 


The adjustment criterion used for 
analysis on the level of the normal-neu- 
rotic group was the number of tallies 
assigned to a Rorschach record on the 
Munroe revised check list. This is a rela- 
tively objective rating system which has 
been standardized on college students 
Similar in many respects to the members 
of the normal-neurotic group in the pres- 
ent. study. By assigning individuals to one 
of three levels of adjustment on the basis 
of the number of check list entries, Mun- 
Toe obtained a contingency coefficient 
of 62 between the adjustment ratings 
and carefully obtained external criteria 
of adjustment (7). 


2. The Order of Merit Rating 


For analysis on the level of both groups 
Combined an Adjustment Score was ob- 
tained by transmuting into units of 
amount an order of merit ranking of the 
60 records on the basis of the efficiency 
of the subjects’ general adjustment. This 
ES Used in preference to the Munroe 

Sed check list because Munroe in- 
uim no psychotics in her standardiza- 
Ма Study. It was judged to be a feasible 
ые because of great range of ad- 
ment represented by the бо cases. 
anking of the Rorschach records was 
ene by an experienced Rorschach 


worker who had no access to any data 
other than the Rorschach protocols, the 
Klopfer scoring of each record, and the 
age and sex of each subject. Good adjust- 
ment was defined for him as freedom 
from psychoneurotic and psychotic char- 
acteristics and the ability to use one's 
capacities in a socially effective way. 

A rank-order correlation of .g1 was ob- 
tained between the ranking made by the 
Rorschach worker and a similar ranking 
made by the experimenter. The бо rec- 
ords were also scored by means of the 
Basic Rorschach Score (BRS) of Buhler, 
Buhler, and Lefever (1), and a rho of 
“75 was obtained between the BRS and 
the ratings by the Rorschach worker. The 
ranking by the Rorschach worker was 
used in preference to the other two be- 
сай it was free from the halo effects 
that ‘ight have influenced the experi- 
menter’s ranking and it discriminated 
more effectively than did the BRS be- 


tween the normal-neurotics and the psy- 
chotics. 


B. Tue Dicir TEST 


As with the other tests of the battery, 
the Digit Test was scored in such a way 
that high scores corresponded with weak 
and low scores with strong reality contact. 
In scoring the Digit Test score points 
were added under the following condi- 
tions: 

Digit series repeated accurately but reported 
as incorrect. | 

Digit series repeated inaccurately but re- 
ported as correct. 

Digit series repeated accurately but reported 
as doubtful. 

Digit series repeated inaccurately but re- 
ported as doubtful. 

Discrepancies between responses and 
reports existed in varying degrees so that 
precise scoring called for a system of 
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weighting according to the degree of de- 
parture from objective fact. Empirical de- 
termination of the proper weightings was 
impossible under the limitations of the 
study. However, as with the other tests, 
a heuristic weighting system based upon 
a priori considerations and the evidence 
of the data was adopted. Details of the 
scoring for the several tests are given in 
the original dissertation (5). 


C. THE INFORMATION 'Trsr 


In Scoring the Information Test, five 
different tabulations were made: The 
number of items marked correctly in 
black, the number of items marked їп- 
correctly in black, the number of red 
marks, the number marked correctly in 
red, and the total correct marks in both 
red and black. The five different classi- 
fications were named and symbolized as 
follows: fy 

(2 

Positive Rights (PR) we 

Positive Wrongs (PW) 

»uesses (С) 

Guess Rights (GR) 

Knows (K) 

The first three of 


these scores are self- 
explanatory, 


The fourth Score (GR) is 
Че number of items marked 


correctly in red, but is the figure obtained 


after the usual Correction for guessing is 
applied. The fifth Score, K, is the sum of 
PR and GR. K represents the absolute 
number of items answered correctly with- 
out regard to whether the subject is cer- 
tain or merely guessing. 

The Ру”; 
to be instances of reality 


le subject was cer- 
ledge when he should 
been undecided and undecided 
when he should have been certain. The 
sum of PIV and GR could not be used as 
a measure of reality contact, 
since the absolute size 


have 


however, 
of PW and GR 


varies with the size of К. For example, 
individuals with a very high К score wil 
have relajively lower PIV and GR woes 
the test is so easy for them that relatively 
few questions raise any doubt in pius 
minds. Likewise, individuals with very 
low K scores will also tend to have very 
few PW's and GR's. Many items are com- 
pletely unfamiliar to them, and such iud 
pletely unfamiliar items are not pos 
narily marked in black nor are the) 
zuessed correctly. 

и How to енед for the size of K was p 
most difficult question in devising Si : 
Scoring system. The method fina p 
adopted was that which discrimina 
most significantly between the two ET 
of subjects. This is expressed by th 

formula: 


PW+GR 
ИК + д 


where g is the number of guesses (not = 
exceed 6), and k is the amount (йор la 
exceed g) by which 34K exceeds PW. и 
those records where 34K was greater tha! 
PW plus G, the formula used was: 


PW+GR 


РИ +С 


"ores. 
g weights for several of the test ed 
notably the Information "Test score (де Й in 
above) and the Deviations Score (desorib sr 
section F, 2, below) were derived from "a 
ences noted between the psychotic group iting 
the normal-neurotic group. The resu ups 
Weights were then applied to the same pm a 
from which they were derived instead y^ va- 
“cross-validation” Sample. An inflation os this 
lidity coefficients may have been caused by such 
Procedure, but certain facts suggest that 
inflation was minimal: 

а. Some of the Scores (e.g., e 
score and the Multiple Choice Storics roup 
score) were not weighted by reference to Е аца 
differences. Yet these scores have validity jonet 
or superior to scores that might be quest 
(cf. Tables 3 and 5). 110016 

Correlations within the mures the 
group would not be greatly affected b) 


Scorin 


«ose Test 
the Digit ist 


MEASUREMENT OF REALITY CONTACT 9 


psychotic vs. normal-neurotic group differences 
that guided the assignment of weights. Yet the 
r's within the normal-neurotic group are con- 
sistently positive (cf. Table 3). e 

; c. Although the Omissions Score (see section 
‚ 1, below), is less directly affected by group 
differences than the Deviations Score, it is more 
highly correlated with the criterion (cf. Tables 
запа 5). 


— inflation of validity coefficients may 

hte реп from the weighting methods used, 

аан а ion is probably not a major factor 
es not enter into all scores. 


D : 
. Tue MULTIPLE CHOICE STORIES TEST 


Since the choice of story endings in the 
Multiple Choice Stories Test was gov- 
ered by different factors in the case of 
different subjects, a count of the number 
of realistic endings chosen has no definite 
Meaning, There is no significant differ- 
ents between the two groups in the ab- 
не number of realistic endings chosen. 
Ed value of the test lies not in any 
So nical summation of the choices but 
eoe its use with inquiry asa method 
nas iting the criteria of choice, the sub- 
Jec's particular mode of organizing or 
perceiving the problem of the story. 

All the bases of choice which were re- 
ported in the inquiry were listed, and 
Poi, aed for their classification were de- 
ipn ind The resulting categories were 
М arranged on an a priori basis into 
б-а of objectivity. The levels of 
Майна oc. and the categories they 1n- 

are as follows: 


aan d (a) More probable of occurrence; 
Led. consistent with the facts given. 
Outcom B (a) Happier or more satisfactory 
develo е; (b) Better for characters’ personal 
T oe (c) Greater social good; (d) In 
universa with moral or ethical principles of a 
L sal kind. 
itis ba C: (a) Rationalizations (subject argues 
Plausibl pleasant but unrealistic ending 15 more 
Prejudi e, logical, or realistic); (b) Personal 
itene ae onal likes and dislikes; (c) Con- 
Moral тш. dogmatic, provincial, or childish 
L principles. 
evel D: The reasons for choice are irrele- 


vant И 
to the central problems of the story. This 


rationalizations, impossible 
and the ignoring or 
the original 


includes absurd 
cause-effect relationships, 
twisting of salient relations of 
story. 

A ratings were weighted as zero, B 
ratings as one, C ratings as two, and D 


ratings as three. 


E. THE ACTION PICTURE TEST 
Two scores were obtained for the Ac- 
tion Picture Test: viz., a Distortion Score 
and a Closure Score. 


1. The Distortion Score 


To obtain the Distortion Score, each 
drawing was divided into a number of 
sub-wholes and relationships, and the re- 
sulting units were rated, piecemeal. Addi- 
tional points were added when the total 
gestalt was radically modified. 

Each of the component units of a draw- 
e ue rated on a five-point scale and 
аѕ “ed values from zero to four. The 
criteria for assigning the respective values 
were as follows: 

: No clearly visible alteration. 
: Alteration is clearly visible but not obvious. 
Alteration is obvious but not marked. 


Marked alteration. 
Extreme alteration. 


mere 0 


An alteration, to be scored, had to be 
a clearly visible alteration in relative size, 
direction, or proportion. No attention 
was paid to such factors as the amount of 
pressure, thickness of lines, erasures, ог 
the like, Examples of subject's drawings 
and their assigned ratings appear in the 
original dissertation (5). 

After rating the component units of a 
drawing, the drawing was regarded as a 
whole to judge whether the essential 
meaning of the stimulus picture was 
maintained. In some instances, particu- 
larly in the records of psychotics, the 
gestalt disintegrated so that the repro- 
duction was a meaningless collection of 
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parts rather than an organized whole. 
Two degrees of destruction of the gestalt 
were quite easily recognized. These were 
called partial destruction and complete 
destruction. In partial destruction some 
semblance of the original unity remains, 
but only by effort can the relationships be 
held together. In complete destruction 


2. The Closure Score 

To ascertain w. 
encies were to an 
of a general distortion 


hether closure tend- 


toward and away from 


a five-point scale accord- 


ing to the same criteria used for rati 


alterations in the drawings (IL E 
Of errors in the direction ОЁ closu 
Plus values; Tatings of errors j 
away from Closure were given mi 
stances of Partial or com 


IC signs were disregarded, Ex- 
closure Tatings 


groups of subjects, 
only tended to give di 
their reports in m 


Scantier or omitted details that were re- 
Ported by the majority of the nna 
neuroticGgroup. A Scoring system was 
therefore used that recognized both these 
dimensions, The two aspects of a record 
were Separately scored, as the Omissions 
Score and the Deviations Score. 


1. The Omissions Score 


The Omissions Score was based upon 
the number of frequently reported items 
omitted from a record. A check list tor 
determining the Omissions Score was ш 
pared, and items on the check i igh 
checked if the corresponding details © 
the picture Were not correctly reported н : 
the subject being rated, Included in a 
check list were all details that were со! é 
rectly reported by 50 per cent or more ке 
the normal-neurotic subjects. Items bs 
weighted according to the frequency Ei 
their correct report within the norma 
neurotic group. 


2. The Deviations Score 


The Deviations Score was a measure E 
the degree to Which a subject's cow 
deviated from the objective character É 
tics of the stimulus pictures, To id ма 
а method for obtaining the raped 
Score, a Classification of the various (уре 
of deviations was made and the number 
of each ‘ype of deviation was ae 
for each Stoup. Except for certain libe 
ties taken in the interest of consistency 
Scoring Weights were based upon КО 
parative frequencies from one group he 
the other, р or each class of deviation = 
Weighting approximated the ratio of re 
frequency in the psychotic group to p. 
frequency in the normal-neurotic grou} 


Е he . 
Examples ор kinds of deviations and t 


к ^ ivi in 
weighting assigned to them are given 
the dissertation (5). 


Ill. RESULTS 


А. RELIABILITY OF TEUrs 


ii poe 1 present the split-half reliabil- 
А ity coefficients and the standard de- 
Viations of the several test scores. Except 
in the case of the Closure Score, the reli- 
abilities are above .60, and the tests may 
therefore be considered adequate, in so 
far as reliability is concerned, for the 
Sroup comparisons made in the present 
study. Because of the low reliability of the 
Closure Score, it was excluded from all 
further analysis. 

For individual comparisons, reliability 
should be .go or higher; and for practical 
Usefulness the criterion of .go should be 
attained within the normal-neurotic 
range. The increases in test length re- 
quired by the Spearman-Brown formula 
to attain the criterion of до within the 
be mal-neurotic range are entirely feasi- 

le for all tests except the Digit Test and 
the Information Test. These tests, if in- 
creased to the predicted length, would 
need to be administered in several ses- 
Sions in order to exclude the factor of 
fatigue, In addition to increasing test 
length, reliabilities might be further 
raised by the correction of certain weak- 
ман discussed below (III, В, 1). It тау 

€ concluded that, with the exception of 


the Closure Score, the reliability coeffi- 
cients are sufficiently high to warrant the 
further use and development of the tests. 


B. VALIDITY oF TESTS 


Consideration of the test validities was 
approached from two standpoints. Efforts 
were made first to determine the pos- 
sible influence of irrelevant variables up- 
on the test scores. Secondly, an attempt 
was made to ascertain whether the be- 
havior sampled by a test is representative 
of all or part of what is meant by reality 
contact in real life situations. In this lat- 
ter sense a test is valid in so far as it has 
some meaning apart from the actual task 
it imposes. 


- 4. Freedom from Irrelevant Variables 


e 
NT problem of eliminating irrelevant 
variibles from the test battery was not 
equated with a search for primary factors. 
Even though the tests should be freed 
from the undue influence of irrelevant 
factors, the functions measured may still 
partake of several abilities—and these 
may turn out to be no different from such 
classic functions as memory, ability in 
spatial relations, inductive reasoning, and 
the like. That this should be true does 


TABLE 1 


RELIABILITY COEFFICIENTS AND STANDARD 


NoRMAL-NEUROTIC GROUP AND 


DEVIATIONS OF ТЕЅТ SCORES IN THE 
ix Borg Groups COMBINED* 


Normal-Neurotic Group 


Both Groups Combined 


Tes 

t r SD r SD 

Digit Test .64 5.6 .83 10.7 
wiformation .73 29.8 +71 40.1 
Multiple Choice .84 6.3 -89 10.3 
istortion Score .88 18.2 +93 42.0 
losure Score „Тї 20.8 +26 19.2 
missions Score 73 8.4 “91 19.7 
eviations Score -94 22.2 -92 28.8 


. 
(All coefficients have been corrected by the Spearman-Brown formula) 
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not necessarily imply that reality contact 
might better be assessed through an iso- 
lation and measurement of its constitu- 
ents. Although reality-testing tasks un- 
doubtedly involve the known mental 
abilities to a greater or lesser extent, the 
issue is not whether an individual has 
these abilities but how well he can utilize 
them in the service of relating himself to 
reality. Reality contact is probably not a 
discrete function in the sense of being 
independent of other abilities, but it may 
Prove to be a unique function in that its 
total variance cannot be accounted for by 
the variance of its known ingredients, 
The aim in measuring reality contact is 
to sink a probe into human behavior. at 
an angle different from tha 


t of other 
tests. Though the t 


€sts may cut across 
the same abilities as sampled by other 
tests, these abilities are sampled ina 
unique way, 3 
a. The Digit Test. ExaminatiéZ of 
the Digit Test results indicated that 
memory span for digits was not excluded 
as a variable in those Subjects who had 


unusually high memory span for digits, 
This was because none о 


r them to raise 
ds about the ac- 
ponses, Although this 
test. defect may have resulted in a sub. 
Stantial error of measurement in several 


as necessarily limited to 


obtained. When corrected for attenua- 
tion, this was raised to .60. This correla- 
tion maybe spuriously high "because of 
the test defect mentioned above, but ae 
nevertheless indicates that something in 
addition to memory span was measured. 
It is to be expected that reality contact 
should correlate with memory of all kinds 
and that this particular test of reality pap 
tact should correlate highly with memor) 
span for digits. But the relatively low cor- 
relation obtained supports the view that 
having an ability is not necessarily equiv- 
alent to being able to use that ability in 
relating oneself to reality. А 

Another problem of interest is whether, 
when memory span is held constant, any 
significant relationship remains between 
the criterion of adjustment and the Digit 
Test score. Memory span for digits cor- 
related with the Adjustment Score to 
the extent of -38, while the Digit Test 
Score correlated with the Adjustment 
Score to the extent of „бо, Partialing out 
memory span resulted in a net correla- 
tion between the Adjustment Score and 
the Digit Test score of .52. It is probable, 
therefore, that the Digit Test score is not 
only somewhat independent of memory 


ер‹ ant to 
‘pan but also that it is more relevant t 
an individual's 


ory span, 

b. The Information Test. 'The results 
of an item analysis Suggested that eight 
9r ten of the Information Test items in- 
troduce а factor of reading comprehen- 


s я ee alse 
sion by leading the subject into fal 
Premises or by 


x : m- 
adjustment than is me 


suggesting a fallacious 
answer, Obviously a subject must undc! 
Stand the question before he is able E 
make a judgment upon his knowledge 
concerning the question, t 

Another problem concerned the exten 
to which the actual amount of inform 
tion known varied with the Information 


^ 


o 
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Test score. K, which represents the ab- 
solute number of items correctly marked, 
was correlated with the Inforntction Test 
More and an r of .61 was obtained. Cor- 
we for attenuation this was raised to 
81. The result indicates that something 
regi than a person's store of information 
Was measured. The rather high correla- 
pv ont To of test defects. Subjects 
fund e ig = ability and a large 
MS м ormation аге тоге likely to 
ШЕЕ —_ епо which are 
ing they с of this understand- 
ime bin l have a greater number of 
рї; кы ы, (higher K) and a lower 
еня i st Test score (indicating higher 
that be tate To the extent, therefore, 
лп e pee Test score is con- 
Pishensis with a factor of reading com- 
hiet sion the correlation is spuriously 
gh. 
‘mi, Pr npn to adjustment of the 
Test se A variance in the Information 
"bord not accounted for by factual 
л и was also investigated. Ihe r 
49 whil e = the Adjustment Score was 
Test Nos ia r between the Information 
63, рш. сз the Adjustment Score was 
temained ber. out K, a net correlation 
and the I miis Adjustment Score 
There ig = кено Test score of .53- 
only th reason to believe, therefore, not 
уены factual knowledge and the 
Donequiv, of one's factual knowledge are 
one’s а, but also that awareness of 
8eneral DAN has more bearing upon 
Posrension justment than does the mere 
Dee n of knowledge. | 
The te Multiple Choice Stories Test. 
Subject’s response to the Multiple 


Cho; 

-hoic Е É : 

i ж, Stories Test was not restricted 
of dimension, since within the limits 


tha 5 
material he was free to choose the 


dime 
nsu. E 
*n to which he responded. For 
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scoring purposes, however, all responses 
were ordered to the single dimension of 
objectivity. It was assumed that, whatever 
other qualities behavior possesses, it also 
varies in its degree of objectivity or in 
the degree of reality contact it manifests. 
Validation of the scoring procedure re- 
quires scaling of responses by a number 
of judges and other experimentation. 
However, within the scope of the present 
study empirical validation of the scale of 
objectivity appeared in the distribution 
of responses for the two groups. Of all 
responses made at the highest level of 
objectivity, the 4 level, 75 per cent were 
made by members of the normal-neurotic 
group. Proceeding down the levels of 
objectivity, the proportion of responses 
from the psychotic group increased pro- 
gressively. 

@ The Distortion Score. Irrelevant 
vai, bles that might feasibly influence 
the Distortion Score are motor skill and 
the care or effort expended in the task. 

It is doubtful, however, whether motor 
skill in this test situation can be thought 
of as independent of reality contact. Al- 
though subjects. can point out discrep- 
ancies between their own reproductions 
and the original drawing, it is not neces- 
sarily to be inferred that their errors arise 
from motor disability rather than from 
reality contact weakness. 
nt scoring system used, a per- 
son with normal motor control can reproduce 
the drawings accurately if he perceives them 
accurately. The reason individuals make errors 
which they can later detect as errors is probably 
because visual perceiving (or the mere con- 
templation of an object) does not result in the 
same perceptual emergent as does the visual 
motor effort of drawing the object. The strong 
involvement of the motor functions makes for 
a different sampling of the organism's energy. 
with some subjects the greater participation of 
the motor apparatus tends to increase the in- 


fluence of the inner personal organization caus- 
ing a greater deviation from the stimulus 


Under the lenie 
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object. In other individuals the Opposite may 
be true: Involvement of the motor functions 
produces a product more in harmony with the 
stimulus object. 

Although capacity for motor control prob- 
ably has only a negligible effect upon the Dis- 
tortion Score, a factor of effort is undoubtedly 
involved. By tentative sketching and frequent 
erasures certain subjects were able to produce 
a relatively flawless copy of the original, They 
improved their visual-motor product by check- 
ing and rechecking, perhaps by comparing it 
with a purely visual Perception, With tachisto- 
scopic projection and drawing from memory 
this factor could be more adequately controlled. 

To make the most efficient use of visual 
motor tests, it is necessary to identify their 
principal qualitative dimensions, Although dis- 
tortions may be measured in terms of degree, 
they also vary in kind. Because of the various 
qualitative possibilities for response, the total 
distortion score is a rather crude measure, Never- 
theless it is a meaningful measure in that it 
varies in a general Way with adjustment, 


ё. The Closure Score. The dimensions 
represented in the Closure Score can only 
be guessed at since the score itself lac//q a 
sufficient measure of inner consistency. 
It is probable that the Closure Score is 
the effect of multiple causes and that 
these causes Operate in Varying de- 
grees with different pi 
different subjects, Negat 
for example, 
over backwar 


not Correctly re. 


ported, is qualitatively different from the 


other measures used in the study. The 
other scores are chiefly concerned with 
the degré? to which objective events = 
subjectively distorted. The per 
Score is a measure of the degree to whic al 
one is aware of those objective relation- 
ships which are perceived by most уве 
Obviously, since the scoring system tor 
computing the Omissions Score is or 
upon deviations from normative m 
ards, the validity of the measure Le ie 
upon a scoring system developed from 5 
much more extensive sampling than tha 
of the present study. 


2. Wider Applicability 

Are the measurements obtained ge 
to the conditions of measurement OF x 
they have predictive value for other d 
tions? Findings relevant to this qu 
are reported in Table э. Additional fin 
ings, which concern the relationships "3 
tween test scores and the criterion of ad- 
justment, are reported later (III, C). 

Table 2 reports the test means ап ; 
Standard deviations for each group, e 
gether with the critical ratios of the dit- 
ferences between the means on each € 
It also reports for each test the percentag" 
of the normal-neurotic scores that ОУ! 
lap the median of the psychotic gea 
and the percentage of psychotics’ sco! 1- 
that overlap the median of the norma 
neurotic group, In addition to these ym 
for individua] tests, the same data ee 
given for a Composite Score. The ae 
Posite Score represents the average of tU 
T' scores of the severa] tests of reality She 
tact (excluding the Closure Score). T үх 
last column of the table reports the а 
relation of each test with the Compost 
Score. ay 

The findings reported in Table 2 ™ 

€ summarized as follows: 


a is по 
1. The hypothesis that the~ ÍS 


MEASUREMENT OF REALITY CONTACT 


TABLE 2 


Mra i 5 
IEAN AND SD or ЕАСН Test SCORE AND OF THE COMPOSITE SCORE, CRITICAL RATIOS, PERCENTAGE 
OVERLAP, AND ryoF EACH TEST WITH THE COMPOSITE SCORE 
v x 


J-N зу! i 96. % A 
SERA N-N. Group Psychotic eR NN. Psy. cum 
ш olaps  o'laps ompos. 
Mean SD Mean SD Psy. N-N. Goare 
Digit 
4 9.87 5.58 21.2 4.80 10 13 .71 
Information 76.8 28.6 135-6 4.71 7 7 .73 
ats ons Score 23.5 B.A3 $2.0 10.48 o o .82 
Буа поле Score’ 26.33 22.2 42.0 2.16 13 33 54 
poruon 53-0 18.24 99-34 6.69 o 13 79 
Multi E 48.53 20.82 43.0 1.14 47 27 
Es tiple Choice 12.07 6.30 26.8 7-42 3 то 87 
"posite 44.87 2.66 55-17 8.31 o o 


Significant difference between the two 
Stoups is rejected beyond the 1 per cent 
Confidence level for all test scores except 
tie Picture Description Deviations Score 
бы the Closure Score. The hypothesis is 
s E at about the 5 per cent level for 
ri creada Score. The difference be- 
not si пе means of the Closure Score 1s 
ignificantly greater than chance. 
enn is a tendency for scores of the 
iss otics to overlap the median of the 
ormal-neurotics to a greater extent than 
medi scores overlap the 
ian of the psychotics. 
е ai Composite Score shows less 
iie ee in either direction than the 
tom 8e overlapping of the scores that 
pose it. 
oe of the tests comprised in the 
puss, Sen, Score correlate with the Com- 
greate core to an extent significantly 
whol 5 than that due merely to the part- 
т е relationship involved. 
hyp А A first finding—the rejection of the 
Means = of no difference between the 
hyp dise the two groups—supports the 
Most: plan, of wider applicability. The 
rences usible inference is that the dif- 
etween noted are due to a relationship 
chopath bi scores and degree of psy- 
might is ову. Any other variables that 
Ogically be related to the test 


_hormal-neurotic 


scores are substantially equal in the two 
groups. 

The finding that the scores of the 
psychotics tend to overlap the scores of 
the normal-neurotics to a greater extent 
than the reverse is true suggests that a 
high score on a single test is a stronger 
irdicator of pathology than a low score 
SN the lack of pathology. The overlap- 
ping of the two groups may be partially 
accounted for by errors of measurement, 
but several of the overlapping scores de- 
viate too greatly to be explained by error 
of measurement. This fact is not discon- 
certing since it is to be expected that 
some psychotics will display greater 
reality contact at specific times and with 
respect to specific situations than will 
certain neurotic individuals. The rela- 
tively large overlap and poor differentiat- 
ing power of the Deviations Score is 
cancelled out if the Omissions and Devia- 
tions Scores are combined. Certain psy- 
chotic subjects were able to attain a low 
Deviations Score by withdrawing from 
the situation, but in so doing they ac- 
cumulated a high Omissions Score. 

The significant correlations found be- 
tween individual tests and the Composite 
Score also support the hypothesis of wider 
applicability. It is noted that the tests 
which correlate most highly with the 
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Composite Score—the Multiple Choice 
Stories Test, the Omissions Score, and 
the Distortion Score—are also highest in 
the other ‘criteria of validity. Their re- 
liabilities are high and they show the 
greatest differentiating power in terms 
of critical ratios and degree of overlap. 


C. CORRESPONDENCE ОЕ TEST Scores 
AND ADJUSTMENT 


1. The Normal-Neurotic Group 


The results pertaining to the relation- 
ship between test scores and the Munroe 
check list ratings within the normal- 
neurotic range are presented in Tables 
3 and 4. Table 3 reports the intertest cor- 
relations within this range. Table 4 pre- 
sents the successive multiple R's obtained 
after the addition of each test, according 
to the Wherry-Doolittle method of test 
selection. Since, as is seen from the taz 
the addition of a fifth test Тоне 
correlation, there was no point in carry- 
ing the computation any further, 

Conclusions derived from the results 
reported in the two tables are as follows: 

1. All test scores correlated positiv 
with the criterion, though only the О 
sions, Score showed a statistica 
cant relationship, The ; be 
Omissions Score and 
beyond the 1 per cent ley 

2. The intercorrelati 


ely 
mis- 
lly signifi- 
tween the 
the criterion is 
el of significance, 
ons of the several] 


TABLE 4 


Successive MULTIPLE R's WITH THE ADU 
MENT Світ хох RESULTING FROM THE ADD 
or TESTS By THE WHERRY-DOOLITTLE 
Test SELECTION METHOD 
(Normal-Neurotic Group) 


Tests Added | Resulting К 


Omissions Score -57 
Information Test -64 
Multiple Choice 67 
Deviations Score -69 
Digit Test -68 


tests were for the most part nonsignil 
cant, indicating a high degree a 
specificity within this range of adjus 
ment. 05 

3. The r of .57 between the Omissions 
Score and the criterion, as well as y 
multiple R of .69, support the e Mert 
that reality contact is related to jn na 
ment within the normal-neurotic range. 
Additional evidences of a relationship аге 
reported below (III, C, 1, a). "E. 

a. Relation of tests to the criterion 
is premature to draw conclusions nin 
such a small group and without a per 
carefully obtained criterion. poner 
comparing the multiple R of .69 we 
Munroe’s contingency coefficient of 2. 
between her check list and carefully M 
tained validating material (7), it ui é 
seem very worth while to develop ks 
tests further. The multiple R was pd 
tained with only three tests, Althoug 


TABLE 3 


INTERCORRELATIONS OF TEsT 


SCORES AND THE 


MUNROE ADJUSTMENT 
MUNROE z) 
RATING IN THE Мовмат-№ EUROTI 


с Group — 
à F a just- 
Spes Digit Omis- Devia- Informa- Distor- Multiple а 
sions tions tion tion Choice те 
"e 8 
Digit +067 — .088 „28 = ‚588 +33 
Omissions Score 067 129$ e os 2238 =й B 571 
Deviations Score — .088 +295 —.о4ї — .076 —.235 207 
Information -283 —.173 = 084 .261 2d 
Distortion —.033 +211 — .076 -084 ‚276 2295 
Multiple Choice - 588 —.141 — +235 +261 -276 = 
Adjustment » +338 +571 -297 +219 ‚298 .228 — —_ 


— шшш 


— — ==: 
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four scores were used, the Omissions and 
Deviations Scores are both obtained from 
the Picture Description Test. The three 
tests which produce the multiple R are 
all relatively objective and are adaptable 
to group administration. 


The low correlations between the criterion 
ag all measures except the Omissions Score 
еи іп part that the functions measured 
S ests have very little relationship to ad- 
Justment within the normal-neurotic range— 
A MH AU shown, they do have power 
К dee between psychotics and non- 
PRAN re It is probable that some of the dimen- 
ST Mained in the tests are related in an 
ae or reat way to adjustment within 
Wo ELS “neurotic range. Curvilinearity could 
кой established, but analysis of individual 
AS ӨШ; made evident that certain subjects 
ae Strict adherence to objectivity by spe- 
SLT. They clung to reality with a tenacity 
еды ing a neurotic defense mechanism. How- 

er, when real perceptual disturbances are 
Present, the drive for objectivity does not actu- 
ally produce objectivity. 


Although test scores were frequently 
relatively lower (stronger reality contact) 
than the adjustment rating, scores con- 
Spicuously higher than the adjustment 
rating rarely occurred. This was demon- 
strated statistically in the following way: 

The highest test score of each subject 
wag correlated with the adjustment 
Criterion, The resulting т was .58. 

The lowest test score of each subject 
Was correlated with the adjustment 
criterion. The resulting т was .25- 

Tb evidence suggests that low scores 
are less indicative of good adjustment 
than high scores are symptomatic of mal- 
ee The actual test score that is 
tln not matter. A real weakness та 
of "d pan at any point 15 indicative 
Ж е adjustment. It must be borne in 
tween, а that the difference be- 
signifi k he coefficients of .25 and .58 15 
dis Te. at only about the 10 per cent 
Needed. тапсан a larger sample is 

- Nevertheless, the r of .58 is 
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highly significant and is further evidence 
of a real relationship between reality con- 
tact, as measured, and adjustment within 
the normal-neurotic range. 

There was also further evidence of the 
relation of test scores to adjustment. 
When separate tests were combined into 
a composite score, the correlation with 
the criterion was increased. Thus, the 
average of the T scores of five tests (ex- 
cluding the Omissions Score and the 
Closure Score) gave the significant r of 
.53 with the criterion, even though none 
of the scores contained in this average 
had a greater r than .34 with the criterion. 
To predict adjustment within the nor- 
mal-neurotic range, it appears necessary 
either to combine a number of specific 
tests or to construct tests that sample a 
larger area of the phenomenal field. The 
success of the Omissions Score is prob- 
ay partially due to the fact that it pre- 
ѕећ. а more complex reality-testing task. 

b. The Omissions Score. Since the 
Omissions Score is related to the criterion 
in a significant way, the nature of this 
measure is important to understand. The 
Omissions Score represents the number 
of frequently reported items in the Pic- 
ture Description Test that are not cor- 
rectly reported by a subject. It is sensitive 
both to a narrowing of the perceptual 
field and to tendencies to organize the 
perceptual field in unique ways. Since 
the Omissions Score correlates very highly 
with the total number of items correctly 
reported (7 equals .87), the main factor 
measured is probably the degree of con- 
striction of the perceptual field. The 
theoretical significance of this finding is 
in its consistency with those theories 
which suggest that when the organism's 
capacities are reduced by injury, disease, 
or senescence, it maintains equilibrium 
by return to a lesser level of organiza- 
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TABLE 5 
INTERTEST CORRELATIONS IN THE COMBINED GROUP 
x " P NET ce Adjust- 
" Omis- Devia- Informa- Distor- Multiple Com 
Scores Digit sions tions tion tion Choice posite ment 
4 .60 
Digit +35 -08 -54 -44 E q “66 
Omissions Score (58 .26 «S3 -63 +59 ee “as 
Deviations Score +08 .26 I3 ss à 54 ps 
Information NE +33 +13 +36 БЫ 73 155 
Distortion , 44 -63 55 36 бт “79 E 
Multiple Choice 84 -59 -47 55 бт | -87 e 
Composite 71 .82 .54 „73 -79 .87 3 
Adjustment .бо «66 -45 -63 -55 -73 о 2223 


tion. Because the orga 
with intruding stimuli, it withdraws or 
incapsulates and only in this way main- 
tains equilibrium, The process has been 
referred to by Goldstein as the “catastro- 
Phic reaction” (2, pp. 117, 136, 318), by 
Snygg and Combs as “tunnel vision” (8, 
P- 125), by Lewin as "encysting" (6, P- 94). 


nism cannot cope 


2. Both Groups Combined 

Table 5 presents the intercorrel; 
of the several test scores, the Сот 
Score, and the Adjustment Score in the 
combined (normal-neurotic and psychot- 
ic) group, Comparison of these data with 
the analogous data of the normal-neurotic 
group (Table 8) discloses tend 
cerning test Specificity 

a. The higher ога 
relations in the comb, 


usite 


encies con. 
and generality: 

€r of interest cor- 
ined group suggests 
generality for the 


b. The higher order of correlations 


between tests and criterion in the co 
bined group suggests that adjustment is 
dependent in a broad way upon reality 
contact even though minor differences in 
reality contact may not be directly ге 
flected in adjustment. 

с. The greater correspondence of the 
adjustment criterion with the Composite 
Score than with any of the individual ees 
Scores supports the finding in the norma | 
neurotic group that the more generalize? 
the measure of reality contact the stronge! 
is its relation to adjustment. 

Although the Significance of these 
tendencies js doubtful, particularly since 
two unlike Broups are combined, the poil 
clusion may be tentatively drawn tha 
test scores operate in a fairly specific pic 
within a limited range of adjustment, i 
that an individual's level of adjustmen 
Sets certain broad limits above and bf 
low which test Scores cannot go. The d 
plications of this conclusion are discussec 
more fully below (IV, A, 1). 


IV. IMPLICATIONS OF FINDINGS 


A. THEORETICAL SIGNIFICANCE 
1. General Discussion 
T evidence for intra-individual 
variability in test scores and there- 
fore a certain amount of specificity of 
reality testing functions is quite clear. 
Nevertheless this intra-individual vari- 
ability is relatively small when compared 
with the range of test scores in the total 
sample. The degree to which the scores 
of the psychotics overlapped the scores of 
the normal-neurotic group and vice versa 
Was relatively small. It may be tenta- 
Uvely concluded, therefore, that some 
Beneral factor present in the tests of the 
present battery had a limiting effect upon 
the range of scores produced by a single 
individual, The finding of limited intra- 
individual variability is in line with the 
d ea that specific kinds of reality contact 
are differentiated parts of the phe- 
Nomenal field and as such are derived 
from and dependent upon the total state 
Of the phenomenal field. The argument 
that these results can be explained just 
4s easily by assuming common elements 
ibi several tests cannot be disposed of, 
vever, without further evidence. 
A Зерені to the tests of the pres- 
Choi attery (excepting the Multiple 
Осе Stories Test) the subject presum- 
у attempts to adapt his own subjective 
oe as closely as possible to the 
aie of objective reality. On 
ошын еше tests а subjects phe- 
bh Dee experience may be much closer 
ies en farther from objective reality 
tests Es average performance, but on 
beum are more general in nature, his 
his — will naturally be nearer to 
jects a average level. To measure a sub- 
general” or “average” reality con- 
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tact weakness, the mean of a number of 
specific reality contact measures may be 
taken, or tasks can be contrived which 
sample a larger area of the phenomenal 
field. The Picture Description ‘Test, 
which involves the perception of people 
and familiar objects in meaningful rela- 
tionships, probably samples a large area 
of the phenomenal field. The same is true 
of the Multiple Choice Stories Test which 
calls for a consideration of real-life prob- 
lem situations. 

Testing reality contact weakness in 
specific situations may be conceived of 
as measuring the distance between the 
point representing objective reality and 
the point on the reality dimension at 
which the task is actually performed. We 
асте that the subject tries to order his 
ex, rience as close to the point of ob- 
jective reality as he can. The validity of 
this assumption is somewhat question- 
able, for although the subject is in- 
structed to be as accurate as possible, the 
task is not crucial to his existence, and 
he undoubtedly permits a measure of lax- 
ness. Some subjects, however, apparently 
do regard the tasks as crucial to their 
existence (an unrealistic attitude) and at- 
tack them with deadly seriousness. This 
difference in attitude is usually revealed 
by internal evidence. It has the greatest 
effect upon the Distortion Score and the 
least effect upon the Omissions Score. 

With the Multiple Choice Stories Test 
it cannot be assumed that the subject is 
even trying to order his experience to the 
demands of objective reality. In this test 
the subject is not told to be accurate or 
realistic but is permitted to seek his own 
most comfortable point on the reality 
dimension. The test is therefore useful 
in determining how close to objective 
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reality the subject orders his experience 
when left to his own devices. A strict ad- 
herence to objective reality under these 
conditions is not a favorable sign but ap- 
pears to be the response of a cramped, 
prosaic, and overconforming individual. 
Under these conditions of free choice, 
however, there is a strong tendency for 
the level of reality chosen to bear a con- 
sistent relation to the person's “general” 
or “average” reality contact weakness (r 
between the Multiple Choice Stories Test 
and the Composite Score equals .87). 


2. Reality Contact in Neurosis 


The frequent assumption that there js 
no difference in perceptual ability be- 
tween normals and psychoneurotics is not 
upheld by the results of the investigation, 
Four different kinds of evidence point to 
а relationship between perceptual contact 
with reality and the degree of ай]изи Аг 
within the normal-neurotic range. “iese 
include: (а) the multiple R; (b) the r 
with the Omissions Score; (c) the у with 
the highest score of each subject; (d) the 
r with the average of five scores which by 
themselves showed no significant 
tionship with the crit 

The general in 
establish the pres 
turbances 


measures that 
between normals 
the perceptual 
usually too slight to 
ordinary condition 
stimulus must be r 
by tachistoscopic methods or 
must be made difficult in some o 
It is evident also that a ] 
phenomenal. field must 


the task 
ther Way. 
arge area of the 
be sampled, AL. 
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though individual, specific measures 
show very little relation to adjustment 
within tlf normal-neurotic range, when 
such specific measures are combined into 
a composite score a significant relation- 
ship appears. The positive results ab 
tained with the Omissions Score ae 
probably due both to the limited ex- 
posure method used and to the fact that 
it samples a larger area of the phe- 
nomenal field. 


B. ApPPLICATIONAL SIGNIFICANCE 

The idea that reality contact а 
regarded as а quantitative feature ие 
Cuts across all qualitative dimensions ч 
behavior is upheld to a large eat а 
the findings of the study. Reality аш 
undoubtedly fluctuates under pine 
conditions, but the data of the n 
nevertheless suggest that a concept bn 
general reality contact, even though it = 
abstracted from particular instances, i 
probably furnish a conceptual tool n 
needed for an appraisal of the extent ca 
maladjustment, Although the Kerr 
tion of Specific kinds of reality contact 
should not be neglected, the more ве 
eralized measures of the present ar 
were shown to have the greatest predic 
tive value, Both in the normal-neurotic 
8roup and in the combined group, the 


А 'reatest 
composite measures showed the great 
correspondence w 


: ips ad- 
ith the criterion of а 
JUstment, Also, 


those tests which cor 
related most highly with the Compos 
Score (the Multiple Choice Stories Te 
and the Omissions Score) were nni 
Strongly related to the criterion of ac 
justment, к s 
The adjustment criterion, since it << 
dependent Upon a variety of дош" 
factors, Should be expected to correla Fa 
most highly with other gnelet ne, 
ures, Nevertheless, obtaining significa! 
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correlations between a general reality- 
contact score and a general Rorschach 
adjustment score implies a validity for 
both measures. If general adjustment 
were not a valid concept to begin with, 
the validity of a general reality-contact 
score could not be demonstrated. And 
although specific areas of maladjustment 
must be located in order to apply psy- 
chotherapeutic correctives, the practical 
value of a gencral estimate of adjustment 
efficiency is not to be denied. 

The battery in its present form is ade- 
quate for distinguishing psychotics from 
neurotics in all but a few borderline cases, 
but it is not sufficiently sensitive to neu- 
тойс disturbances to make valid conclu- 
sions regarding a particular individual. 
A rather maladjusted person will occa- 
Stonally produce a low Composite Score 
(indicating strong reality contact) so that, 
An the battery were to be used for screen- 
ig purposes, certain malfunctioning in- 
dividuals would go undetected. However, 
3 the present data, a conspicuously high 
Composite Score always indicates severe 
disturbance of some sort. 

Reality-contact measurement may sup- 
plement but is unlikely to supplant the 
ie, diagnostic techniques. Practical ad- 
the Ki include the objective nature of 

s and their adaptability to group 
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use. Should the possibilities suggested by 
the present data be fulfilled in later ex- 
perimentation, a way to gauge the extent 
of maladjustment will be established. Yet 
- whether or not the relationship be- 
tween maladjustment and reality contact 
is universally valid—psychodiagnosis ob- 
viously implies more than a determina- 
tion of the degree of malfunction. Also, 
it is wholly probable that in certain mal- 
adjustments perhaps in the affective dis- 
orders —real pathology may exist without 
significant reality-contact loss. On the 
other hand, perceptual deviations may 
in such cases be merely more specific or 
less observable. 

Although not reported in this paper, 
the data of the present investigation also 
suggest that specific kinds of reality-con- 
tact weakness are associated with specific 
behavioral tendencies. Several hypotheses 
аро; this line are offered in the original 
dix, "tation. (5). Knowledge of whether 
reality-contact measures can function in 
precise personality description and in dif- 
ferential diagnosis depends upon the test- 
ing of such hypotheses. And this endeavor 
depends in turn upon well-developed, 
specific tests and criteria, which should, 
perhaps, be closer to actuallife reality 
than are the laboratory-type exercises of 
the present battery. 


V. SUMMARY 


IVE tests were devised for the purpose 
F of measuring weakness of the reality 
contact and were administered to a group 
of $0 paranoid schizophrenics and to a 
heterogeneous group of зо subjects, both 
normal and psychoneurotic. Seven scores 
were derived from these five tests. 'The 
Rorschach was also administered and 
Was used as a basis for estimating the gen- 
eral level of adjustment of each subject. 
Questions to be investigated were the re- 
liability and validity of the severa] tests 
of reality contact, and the relation of the 
measures of reality contact to the level 
of adjustment. 


А. RESULTS 


cor- 
rection by the Spearman-Brown formula 


was sufficiently high to justify use of Ail 
Scores, except the Closure Score ое 


t :94 to .94 in the normal- 
neurotic group, and from ‘71 to .93 in 
both groups combined (normal-neurotic 
plus Psychotic), 


2. With respect to the ‘freedom of the 


tests from irrelevant factors, data were in- 
Sufficient to give a clear-cut answer. It was 
shown, however, that the Digit Test meas. 
ured something in addition to 
Span for digits, and that the 
tion Test measured something 
tion to the actual a 


known, An irreley. 


memory 
Informa. 


comprehension, 


3- Significant differences between the 
mean of the normal-neurotic group and 
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the mearjof the psychotic group were 
obtained in all scores except the Closure 
Score. The critical ratios of these signifi- 
cant differences varied from 2.16 to 10.48. 
Several of these figures may have been in- 
flated, though probably not appreciably, 
by the method of weighting scores (11, С). 

4- Significant relationships were found 
between the measures of reality contact 
and the degree of adjustment within the 
normal-neurotic range. The r — 
the Omissions Score and the criterion Qr 
adjustment equaled 57. A multiple R 
representing the correlation between the 
criterion and three tests (four scores) 
equaled .69. The r between the highest 
Score of each subject and the ge 
was .58. The r between the average o 
five scores (excluding the Omissions 
Score) and the Criterion was .53, even 
though none of the scores contained In 
this average correlated with the criterion 
to an extent greater than 34. 

5. Although there was a large degree 
of Senerality or correlation among the 
Several tests in the full-range samp £ 
(both groups combined), in the Don 
neurotic group the tests were much Ino 
Specific (uncorrelated) in their operation. 


B. Conctusions 


1. The experimental results support 
the belief that relatively objective ап - 
reliable tests of reality contact can be dé 
vised. 
2. The results of the study support s 
Ew that such tests Possess a validity a 
extends beyond the specific conditions 
measurement. he 

3- The data of the study uphold t : 
idea that the weakness of the reality sen 
tact is related to the general level of ii 
adjustment, both within the norma 
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neurotic range and in the total range of 
adjustment. 

_& Within the limits of the study, real- 
пу contact appeared to be both specific 
and general in its operation. Although a 
certain amount of intra-individual vari- 
ability existed from one reality testing 
task to another, the intra-individual 
Variability was relatively small when com- 
pared to the range of test scores within 
the total sample. 
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5. The evidence of the study supports 
the idea that a concept of general reality 
contact has practical usefulness even 
though it be abstracted from specific in- 
stances. 

6. The generally positive results of the 
experiment favor the further refinement 
of the instruments used, the development 
of new instruments, and the further in- 
vestigation of the dimensions and cor- 
relates of reality contact. 
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I PROBLEM AND METHOD 


кты situations | have been 
"gd oc. authorities asa major 
fives which the reactions of schizo- 
dem ag other psychotic persons differ 
aren, normal. The theories relating 
appear lon and schizophrenia, however, 
cede be based mainly upon clinical 
the lite 2 since the studies reported in 
ios at offer little evidence to sup- 
eses, (F etract from the various hypoth- 
15) or a bibliography, see reference 
ial adie study was initiated to pro- 
eviden ore nearly adequate experimental 
ihe мия regarding the difference between 
aiid p tolerance of schizophrenic 
Keen i individuals. The major hy- 
schizop} in the present study is that the 
та iig group will manifest a lower 

titative n tolerance (ї.е., a greater quan- 
Come лине in their level of per- 

owin al than the normal group fol- 
the k ага to attain success within 
is het T fied tasks. A second hypothesis 
will a pones of the schizophrenics 
the vl qualitatively from those of 
tion—for s during and following frustra- 
Bester n example, _they will give a 
Will be t of bizarre responses and 
than Gee apt to abandon the task 
that as E A third hypothesis is 
ure is enco ишаре; of tasks їп which fail- 
бе effet untered increases, the cumula- 

of these succussive frustrations 


will result in a progressively greater re- 
duction in performance, and this cumu- 
lative effect will be greater in the schizo- 
phrenic group than in the normal group. 

For the purposes of the present experi- 
ment, frustration was said to exist when 
(a) the individual had demonstrated a 
need to attain success in a task, and (b) 
success in certain subsequent items of the 
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task was thwarted by virtue ‘of the diff- 
culty of the objective situation. The sub- 
jects were merely informed of failures 
when they occurred. In order to infer 
the existence of at least a minimal need 
for success (making the correct response) 
the subject had to perform adequately 
on three items in the initial form of each 
task (ie. obtain a minimal prefrustra- 
tion score equivalent to three correct re- 
sponses). 
A. MATERIALS 


Four tasks, each consisting of two 
equivalent forms, were employed. Items 
within each task were graded for dif- 
ficulty so that most individuals were 
likely to experience success initially and 
encounter failure on the later more dif- 
ficult items. The tasks as administered 


to the main experimental groups are de- 
scribed below. 


1. Auditory Memory. This task (Digit & 


S an) 
consisted of sets of digits of increasing "ар. 


of approximately one per second 


the shortest Series, which consisted of two num. 


bers. If a Subject repeated the digits 
the next longer series was given with 
ment by the experimenter, In th 
correct repetition the Subject was permitted 
three trials for a given series length before 
it was considered failed. The Subjects in the 
main experimental SrOups were informed of 
failure whenever it occurred by the Statement: 
“That was Wrong: now listen carefully and be 
Sure to get them just. right," ` 

Series up to а length of two digits beyond 


memory span were ad- 


cts, providing а minimum 
тез. Follow 
ures the alternate form 


desc ending order of 


out com- 
€ case of in- 


a for possible n- 
series was given 
€t of three trials 
e trial. The qe. 
scending order was terminated when the shortest 
series had been reached. 

Three points were given for the correct repe- 


tition of any given length of digits on Peus 
trial; two points for the correct repetitio: T 
the second trial; and one point for thc ш 
repetition on the last trial. The ерт ӨШ m 
on the form of cach task iUi Du 
ascending orde of difficulty (until the AE RC 
number of faaures was encountered) is aa 
after referred to as- the prefrustration Ee 
the score obtained on the form of each ved 
following failure is referred to as M NH 
frustration score, The drop score aaa 
Поп score subtracted from the риш, 
score) was calculated for each subject. In sere 
of the following tasks drop scores also 
calculated. in an identical manner. e Re: 
2. Visual Memory. The Benton Ува и at 
tention Test (1) was employed, It койы о 
two forms of seven cards cach, Проп. us in 
one or more geometrical figures are din föl- 
india ink. The subjects were instructed Е an 
lows: *I am Boing to show you some see ll 
Which there are one or morc designs. S EHE 
be given a short time to study each card. shat 
it will be removed and you will draw encil 
you have seen." The subject was given à p size 
and blank paper approximately the Sa ей 
as the cards › 8 inches), At card nut pra 
three (the fi t card with more than oe for- 
sign) the Subject was reminded: "Don't 
get to draw everything you see.” oct 
Each card was presented to the subien 
five seconds and then removed. (Standard б 
ministration time is ten seconds.) рше о 
the brevity ОЁ this task and the likelihooc the 
Partial successful reproduction even on form 
difficult items, ali seven cards in cach 
Were administered, The prefrustration | 
Was administered in ascending order of 
culty and: the postfrustration form in 
scending order, When the subject see ars 
reproduced or omitted any part of the rae 
Оп а card, he was told: “That was gute 
look at the next design carefully and bs of 
to draw everything you see.” In the peal 
correct reproduction no comments were А one 
More sensitive Scoring system than ug into 
used by Benton Was developed which е? 
account the shape of the figures (or н лат 
their horizontal order, their vertical pus two 
and their relative size, Approximately joints 
Points were scored for cach figure, less ] 
subtracted for inaccuracies nsisted 
3- Auditory Perception. "Тһе test e tern 
of two recordings of 54 spondaic words is Jong 
Used in verse referring to a foot of it 'rhe 
syllables) at nine graded intensity 16% ;ondees 
Words were Selected from a list of 70 po ар 
Prepared by the Harvard Psycho -AcouR е н ес 
Oratory (16). The list originally was | home 
to supply a relatively large number 2 ld 
8eneous items to measure the thresho 


for 
ad- 


rectly 


" ЕЕРЕЕ 
ae 


PERFORMANCE OF INDIVIDUALS FOLLOWING FRUSTRATION 3 


ке Pid ер Each form of the test de- 
dierent x the present study consisted of 27 
levels cf spondees recorded at nine different 
ad intensity. There were three words in 
D of the nine different steps. 
"ed Se inno. process al( pf the 54 words 
calibrate cn at a constant vel through. a 
Alte? endi amplifier into the recording device. 
intensity 7 SUD of three words was spoken, the 
thie 4 = of the amplifier reduced by 
in the Bs els until the nine steps (27 words) 
nd a form had been recorded. For the 
Was ies the intensity level of the amplifier 
Another ased ‘alter each step by three decibels. 
enuan tee in which the forms were 
to peris Mas made in an identical manner 
N Tit rotation of the forms.’ 
its ae phonograph equipped with two 
cordin Sco phones was used to play the re- 
worn р d the experiment. The headphones 
the Pos 1c subject were of the type used by 
Sponge ni hon Forces. They had two large 
pieces es ber cups which fitted over the ear 
je ex Шз tended to reduce external noises. 
Ша о abe са wore а single carphone to 
Bib cred the recording. The subjects were in- 
cordin a follows: “I am going to play a re- 
tpe an some spoken words. Your job is to 
have amd wora as soon as you hear it. If you 
you ied difficulty, you should guess because 
meanings get it right. They are all familiar, 
the Wed words," The subject then was given 
= Aeadphones, 
"crx ds intervals of approximately three 
° ihe. petween the words to permit yepeuion 
Of six word by the subject. Usually, an. interval 
Steps, he was allowed between successive 
Were. ^ ut when comments by the experimenter 
1 equired, the interval was longer. 
itene pot control was set initially ata low 
runs di id (a point determined during trial 
identif Which none of the persons tested could 
(ites Ge Шав half of the six syllables 
form, b em in the seventh step of the first 
the thre 1016 subjects who correctly identified 
© the е words in the first step continued on 
maineq pis Steps; the volume-control dial re- 
culty aed. When a subject encountered dif- 
first ана adsatitying all three words in the 
comment: Ue same: Step наз; repeated with the 
iub ye Let's try it again to get used to 
Volume subject still was not successful, the 
Was 3s gradually increased until а point 
Words in Es where he could identify all the 
tinued а the first step. The test then was con- 
nd the volume-control dial remained 


E 
mince fior is grateful to Dr. M. Bergman, 
ete hief of the Audiology Clinic at the 
ire Administration New York Regional 
» tor making the recordings. 


fixed at the new position throughout the pres- 
entation of the two forms. 

When a subject had incorrectly identified or 
omitted three of the six syllables within a 
step (after the first), the turntable was stopped 
and the subject informed of failure. In the 
case of incorrect responses the subject was told: 
“That was wrong; now listen carefully and be 
sure to get the next ones right.” If no re- 
sponses were made, the subject was asked: 
"What words did you hear?" If incorrect re- 
sponses were given, he was informed of his 
errors. When no guesses were offered, he was 
told: "You missed those words; now listen 
carefully and be sure to get the next ones 
right.” No comments were made when more 
than three syllables in any one step were identi- 
fied correctly. The recording was played in its 
entirety for all subjects in the main experi- 
mental groups regardless of the subjects" limens. 

One point was given for each syllable correctly 
identified. The first step of the prefrustration 
form and its equivalent step in the postfrus- 
tration form (ie. the loudest step) were given 
full credit since all subjects were required to 
respond correctly to the very first step. 

4. Visual Perception. The test consisted of 
two forms of 15 blurred words arranged in 
order of difficulty of identification. In order 
teacontrol for differences in the familiarity of 
WON the thirty words were selected from the 
thowànd most frequently used words in the 
Thorndike and Lorge lists (14). Each word was 
seven letters long and no letter was repeated 
within any one word. Varying grades of 
blurredness were obtained by typing the words 
on bond paper and making 14 carbon copies. 
Six different words were typed on each sheet; 
they were typed in capitals with the letters an 
additional space apart to prevent them from 
merging into each other in the blurring proc- 
ess. The sixth, eighth, tenth, twelfth, and four- 
teenth copies were used. The five carbon copies 
(go different words) then were photographed on 
35-mm. negatives. In the reproduction process 
the words were enlarged to approximately orig- 
inal size. Each word was on а separate 3X4- 
inch card of doubleweight, glossy enlarging 
paper. The order of the difficulty of identifica- 
tion of the words was determined by the per- 
formance of a group of normal subjects. The 
words were placed in rank order and divided 
into two equivalent forms. 

The subjects were told: "I am going to show 
vou some photographs of words. These words 
will be blurred, but your job is to read each 
word. If you have any difficulty in reading 
these words, you should guess because you may 
get them right. They are all familiar, meaning- 
ful words. For example, read this one.” The 
subject was given the first card. Whenever a sub- 
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ject indicated that he could not respond, he 
was instructed: “See what letters you can make 
out and then take a guess.” No comment was 
made if a subject correctly named four of the 
seven letters or gave a seven-letter word with 
four or more letters correctly- identified in the 
proper positions. If a word other than one with 
seven letters was given, the subject was asked 
to spell the word. Usually the subject indicated 
which letters he had used. 

When a subject incorrectly identified four or 
more letters in a word, he was informed: “That 
was wrong.” (In the case of no response: “You 
missed that one.") “Be sure to study the next 
word carefully." After the first failure, the 
correct word was named by the examiner. Since 
а blurred word can generally be recognized 
after it has been identified, this procedure 
tended to assure most subjects that the stimuli 
consisted of real letters and Were not merely 
“smudges,” or “fingerprints,” or "ink blots.” 

The main experimental subjects 


were al. 
lowed three successive failures in the pre- 
frustration form (ascending order of difficulty) 


before being given the postfrustration form in 
descending order of difficulty. The postfrustra- 
tion form began with a word at the same level 
of difficulty as the last word failed in the pre- 
frustration form. A score of one point was given 
for each letter correctly identified, 


B. PRELIMINARY EXPERIMENT 

1. Purpose. A defect in on 
vious frustration Studies ( 
of consideration given t 
ences in behavior betw 
and normal individu 
€ven in nonfrustratin 
been shown that sch 
uals are unable to 
mental sets for as Jon 
mals (12). In additio 
tients are more likely 
of their own accord 


€ of the pre- 
2) was the lack 
© initial differ- 
een schizophrenic 
als. For example, 
8 Situations it has 
izophrenic individ- 
maintain effective 
8 а period as nor. 
n schizophrenic pa- 
to discontinue tasks 
(10). Attention and 
ш also ате char- 
acteristics of schizophrenic behavior, ре. 
tasks, these behavior te 
result in a decrement 
merely due to the lengt 
was necessary, 


ndencies might 
In performance 
h of the tasks, It 
therefore, to determine the 
extent to which such variables related to 


the length of the tasks might affect ad- 
verscly the performance of qe 
subjects under conditions of minima 
frustration. А 

2. Populat; т. The 24 male ратан. 
employed in this preliminary study ee 
obtained from the population aimon 
as schizophrenic at the Veterans AT 
ministration Hospital, Northport, ay 
York. They ranged in age from 22 to 35 
With a mean age of 27.6 years. The p 
tients had been hospitalized from severa 
months to over seven years, with a d 
length of hospitalization of 3.5 years. АП 
subjects had been raised in New York d 
immediately neighboring states and n 
completed from 8 to 15 grades in schoo! 
with a median educational level of 11-0 
grades. Their IQ's, roughly estimated s 
prorating their combined Vocabulary ап 
Information subtest scores of the Welt 
ler-Bellevue Scale, ranged from 92 (a € 
bined weighted score of 17) to 1?7 б 
combined weighted score of 27), with Š 
mean of 110 (a combined weighted sco! 
of 21.9). f 

3. Procedure. After administration " 
the Vocabulary and Information subtes : 
of the Wechsler-Bellevue Scale, the a 
tasks were presented to each subject igi 
dividually ina single session. Since 1t W* і 
desired to determine the cumulative effec 
of the variables related to the length 
the tasks, it was necessary to control © 
Position and for the possible effects 
one task upon another. The orders a- 
presentation of the four tasks we al, 
pletely rotated, yielding 24 differe 
orders. Thus every task appeared in а: 
of the four positions, and followed 
rectly each of the other tasks, ап d 
number of times, The alternate formi te 
€ach task also were rotated to elimi 
differences in achievement resulting f° 
possible inequality of the two forms- ts” 

In order to determine the subje¢ 


al 
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maximal levels of performance, failure 
could not be eliminated completely. A 
condition of minimal frustration could 
be obtained most effectively by making 
the number of successive hilures as few 
as possible. The two form’ of each task 
were administered, each in ascending 
order of difficulty. In the Digit Span task 
each form was terminated after three 
Successive failures (a series length one 
digit beyond the just-determined memory 
Span) instead of six as in the main ex- 
periment. In the Auditory Perception 
task each form was terminated after the 
Subject could no longer identify any 
syllables in two successive steps. As in 
the main experiment, all of the Benton 
Visual Retention Test cards were pre- 
Sented and the Visual Perception task 
MAS continued until three successive 
failures had occurred. While the subjects 
Were urged to guess when omissions were 
made, they were not informed of failure. 
Tnose subjects who appeared disturbed 
by failure were assured they had made a 
8ood try, 

4. Results, No significant differences 
Were found between the mean scores of 
the forms administered first and those 
administrated second. The t values ob- 
tained ranged from 0.56 to 1.06. (With an 
i of 23, t must be greater than 1.70 to be 
ш at Ше оло level of con- 
ban Pearson correlation coefficients 
вл, E the first and second forms of 
е m ranged from 0.68 to 0.87. AL 
hà ^a the size of the sample might tend 
bs Ms the possibility of negative re- 
Dicho. x trend suggestive of a decrease in 
— "veg is evident between the 
Hilnistra ministrated first and those ad- 
slight an second. Three tasks showed 
adminis a in the scores of the forms 
task ie second; the Digit Span 
consiste «ма slight drop. The results are 

nt with the assumption that any 


differences between forms obtained in the 
main experimental groups would be due 
to the introduction of the experimental 
variable. 

In order to determine the effects of the 
position of the task on the initial per- 
formance of each of the four tasks and 
on the difference scores (form adminis- 
tered first minus form administered sec- 
ond), the raw scores in each task distribu- 
tion were converted to standard scores. 
Each subject’s scores then were arranged 
in a row according to the position in 
which the task was administered regard- 
less of the nature of the task. An analysis 
of variance technique was employed to 
discover if any differences due to the 
position of the task existed. For the initial 
form scores of each of the four positions 
the analysis of variance technique yielded 
a between-positions variance ratio of 1.06, 
which is not significant. In addition, 
ейыошанон of the mean initial scores 
[о1.?%һе four positions revealed no con- 
sistent trends. For the difference scores 
the between-positions variance ratio also 
was not significant (1.18); the mean dif- 
ference scores revealed no consistent 
trends. Thus the results are consistent 
with the assumption that any obtained 
positional effects in the main experi- 
mental groups are due to the cumulative 
effects of frustration. 


C. MAIN EXPERIMENT 


т. Population. There were two groups 
of subjects, а schizophrenic group and a 
normal group. The psychotic group was 
composed of 48 white male patients 
diagnosed as schizophrenic at the Vet- 
erans Administration Hospital, North- 
port, New York. 'They had been hospital- 
ized for periods ranging from one to nine 
years, with a mean length of hospitaliza- 
tion of 4.75 years. 

The normal group was composed of 48 
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white male patients hospitalized for 
minor surgery at the Veterans Adminis- 
tration Hospital, Bronx, New York. The 
following criteria of normality were em- 
ployed: (a) hospitalization for relatively 
minor operations; (b) recommendation 
by the ward personnel as a suitable can- 
didate on the basis of the absence of ob- 
vious behavior deviations; (c) no indica- 
tion of previous mental disturbance nor 
of any present need for psychiatric treat- 
ment in the patient's medical history; (d) 
à screening interview by the experi- 
menter prior to testing, in which the 
patient was questioned about previous 
illnesses, basis for discharge from service, 
and reasons for disability pensions, if 
any. Any patient whose mental st. 
doubtful was not accepted as a subject. 

The groups were equated approxi- 
mately for age and for intellectual and 
educational level. Al] subjects came from 
New York or immediately neighbor ag 
States. Ages ranged from 22 to 40 y ars, 
With a mean age of 30.77 for the schiz- 
ophrenics and 30.00 for the normals, The 
estimated mean IQ's for the psychotic 
group and the normal Sroup were 108 
and 110 respectively (prorated from the 
Vocabulary and Information subtests), 
with a range of 86 to 128, The subjects 
had from 6 to 16 yea 


rs of schooling, a 
mean of 11.31 years for the schizophrenics 
and a mean of 10.90 years for the nor- 
mals, 


atus was 


A minimal intellectual level of Dull 
Normal ability (an IQ of 80) had been 
established to eliminate severely de. 
teriorated psychotic patients. While the 
experimental battery was not adminis- 
tered to those individuals who failed to 
attain this level, the minimal need re- 
quirements (successful performance jn 
the initial items of each task to obtain a 
score equal to three completely correct 
responses) also tended to disqualify the 


more confused and less compliant schiz- 
ophrenic patients. ld 

2. Procedure. All subjects were to 
that the psychologist was in the ien 
of devising y е new tests of differe d 
abilities, and that it would be appreciate 
if they would help him out by taking me 
tests. Most of the schizophrenic patients 
had received psychological дии 
previously and usually submitted peed 
out further explanation. The shorn 
tients were unfamiliar with psychologica 
tests for the most part and required ms 
elaborate explanations. The exact wee d 
ing of the introductory interviews pes 
with the patients’ educational E 
grounds and personality characteris 
Essentially they were told that the P 
chologist was working on a research pra 
ject designed to compare the abilities F4 
mentally ill and normal people pm 
the use of some new tests, Normals wa 
needed to form the basis for the compa 
son. All questions concerning the ie 
for selection and the tasks involved gar 
answered as honestly as possible poni 
revealing the true nature of the expe 
mental variable, 

The administration of the experimental p^ 
tery to the main experimental groups NS ary 
Same as the administration to the prelim! eri- 
Sroup except for the addition of the Sig 
mental variable as described earlier 1n of 
Chapter. (See A. Materials) The orders 


y ro- 
Presentation of the tasks were completely 


: 25.41 forms 
tated twice Within each group and the 
ОЁ each 


task also were alternated. 

The failures encountered in the test 
tion tended to disturb the subjects in V 
degrees, Primarily as a basis for еш 
а brief interview (developed after five Soy. 
Phrenic patients had been tested) ap the 
ducted with each Subject at the end. asked 
experimental session, The subjects were 

the following questions: 


4. What do you think of these tests? 

b. How do you think you made gut: or got 

c. How did you feel when you failed 
Something wrong? 5 

d. Which was the easiest and whic 
hardest test? 


situa- 
arying 
rance, 
izo- 


е 
h was th 


ap um — 
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If a subject’s responses indicated that 
he was disturbed, he was assured that it 
was natural to feel upset, but that he had 
performed as well as or better than most 
people in his educationay\level. It was 
pointed out that psychological tests were 
analogous to the high jump or pole vault 
In sports. The athlete continues to jump 


7 


until he misses several times. Unless he 
does miss, one could not know how high 
he might have gone. Because these were 
new tests, it was necessary to make certain 
that the subjects had reached their high- 
est level. It also was suggested that the 
items that had been failed in the most 
difficult test were practically impossible. 


П. RESULTS 


А. QUANTITATIVE DIFFERENCES IN 
FRUSTRATION TOLERANCE 

т. Drop Scores. For each task drop 
Scores (i.e., the postfrustration score sub- 
tracted from the prefrustration score) 
Were employed as measures of the ade- 
Часу of the subjects’ performance fol- 
lowing frustration. A large drop score in- 
dicates a low frustration tolerance. 

The results clearly indicate that dif- 
ferences between schizophrenics and nor- 
mals exist in their ability to withstand 
frustration. In all tasks the schizophrenic 
Stoup showed significant mean drop 
Scores (beyond the .oo1 level of con- 
fidence), On the other hand, the normal 
8toup manifested no reduction in the 
ot of performance following frus- 
к Оп in the perceptual tasks. The mean 

P scores of the normals in the two 
Perceptual tasks are well within chance 
mits. In the two memory tasks the nor- 
m 8roup displayed drops in perform- 

ce after frustration that were signifi- 


cant at the .035 level of confidence for the 
Digit Span task and at the .o8 level of 
confidence for the Benton. 

Comparisons of the mean drop scores 
of the two groups reveal that in all tasks 
the schizophrenic group consistently 
manifested a greater quantitative reduc- 
tion in performance following frustration 
than the normal group did. The con- 
sistently poorer performance of the 
schizophrenic group as compared with 
the normal group following frustration 
» 14 to support the hypothesis that 
schizophrenics have a lower frustration 
tolerance than normals. The drop score 
means, standard deviations, and critical 
ratios of the two groups for each task, and 
the comparisons of the mean drop scores, 
are presented in Table 1. 

2. Prefrustration Performance. De- 
spite the approximate equality of the two 
groups in regard to Vocabulary and In- 
formation scores and educational levels, 
differences in the prefrustration mean 


TABLE 1 


Dro: 
P Scorn Means, STANDARD DEVIATIONS, AND CRITI 


сл, RATIOS OF THE SCHIZOPHRENIC (S) AND 


ORMAL (N) Groups ron EACH TASK, AND COMPARISON OF MEANS OF THE Two Groups 


Digit Span Benton Aud. Per. Vis. Per. 
5 N S N S N S N 
Mean 2.98 67 2.98 1.12 | 4:92 1.08 10.38 :35 
CR 2.73 2.20 4-11 4-42 | 6.04 4-72 13-39 9.84 
7.64 2.09 4.88 1.78 5.66 1.59 5.38 .2$ 
CR 
Р 4.51 2.13 3-46 4.18 
level <.oo1 | +033 < .оот < .оої 
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scores occurred in the Visual Memory and 
Visual Perception tasks. It is in these 
tasks that appreciable correlations be- 
tween the prefrustration scores and the 
drop scores exist. For the Benton the 
Pearson correlation coefficients for the 
normal and schizophrenic groups are 0.52 
and 0.29 respectively; for the Visual Per- 
ception task 0.97 and 0.43 respectively. 
These correlations probably are due 
largely to the unreliability of measure- 
ment. Extreme prefrustration scores are 
likely to include a considerable element 
of chance error which may not occur in 
the subsequent (postfrustration) trials 
with consequent regression toward the 
mean (the higher the prefrustration score, 
the bigger the drop score). In the two 
auditory tasks the correlations between 
prefrustration performance and 
Score are considerably smaller and in- 


groups 1n the 
affected by the 
n performance 
- In the Benton 


al (an increase Or decrease 
of one digit in the memory task and of three 
decibels in the perceptual task), In the visual 


tributed to the great 
ment, 


the normal group. The significance of 
the difference between groups then is in- 
creased to beyond the .oo1 level of con- 
fidence. (F esuals 13.92; n,/n; equals 
1/93-) Ur | 

In the vidal Perception task the dif- 
ference between the initial mean scores 
of the two groups is reversed; the schiz- 
ophrenic group obtained a somewhat 
higher prefrustration mean score. An 
analysis of covariance technique yields 
adjusted mean drop scores of 9.38 for the 
schizophrenic group and 1.50 for the nor- 
mal group. While the difference between 
drop score means is reduced, the signifi- 
cance of the difference is still beyond - 
:001 level of confidence. (Е equals 11.97: 
7; [n; equals 1/9.) 


B. QUALITATIVE DIFFERENCES IN 
REACTION TO FRUSTRATION 


Various writers have emphasized dif 
ferent types of reaction to fustana 
The Yale group (3) dealt exclusively wit? 
aggressive reactions, recognizing that ше 
largely ignored consequences of fr We 
tion other than aggression. Symonds Ge 
treated somewhat more extensively ЯЕ 
other consequences, such as constr 
methods and substitute responses. in "e 
latter category he listed abandoning t a 
goal, repeating behavior, fantasy, HE 
sion, and miscellaneous reactions. poen 
experiments (7) were concerned us 
stereotyped, fixated behavior, but he 2 e- 
recognized the existence of other 7 
Sponses such as aggression, regression, A7 ў 
resignation (the lack of overt bete 

The present experimental design “ o 
Such that not all the different едЕ 
reacting to frustration were elicited. се 
example, there was no clear-cut evide” e 
of behavior that could be classified 2$ 7 
8ressive. In addition the relatively p 
Stress employed to induce frustration Jd 
erally did not disrupt behavior to а 


D 
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TABLE 2 
P LEVELS! AND DFS FOR THE QUALITATIVE DIFFERENCES BETWEEN GROUPS 
Before During After 

Q Frustration Frustration Frustration 
\ \Р level df P level df P level df 
Aud. Per. Omissions ‚70° 3 .98 3 .о2 3 
М Рег, Omissions .7о І .20 3 ‚ог 2 
mud. Per. Guesses .90 3 or 3 -80 3 
erseverative Errors .20 1 oor 2 .05 2 
is. Рег, Response Time +30 2 70 3 .05 І 


А 
Only the larger of the two P-level values between which the chi-square value falls is given in this table. 


i fires. The kinds of reactions that 
lan poe tended to be less spectacular 
hose obtained by other experi- 
menters under conditions of greater 

Stress. 
Кы quantitative reduction in the post- 
Tustration scores was a result of an in- 
“геле in errors. For the most part errors 
нед of either totally incorrect re- 
nses (guesses) or refusals to respond 
(omissions). Some understanding of the 
tiers for the difference | in frustration 
Шел e between the schizophrenics and 
in ormals may be obtained by analyz 

8 the types of errors made. 

ate cns technique was employed 
intei s the two groups in the per- 
tis Men чы with respect to such qualita- 
actors as the occurrence of omissions, 
Thee and length of time for responses. 
into ve perceptual tasks were divided 
the em parts for the comparisons: (0) 
Subject one frustration section in which 
most} 5 in both groups experienced 
Sectio се; (b) the during frustration 
тан which all subjects experienced 
which mo the after frustration section 
the bef, m equivalent in item difficulty to 
еуе]$ aeg frustration. section. The P 
Square xi EE of freedom of the chi- 
fe pras es, for the qualitative variables 
Musttation ed in Table 2. For the after 
the differ. section the P levels reflecting 
Calculated ы between the groups were 
on the basis of the change in 


the number of omissions, number of 
guesses, number of perseverative errors, 
and time scores for each individual (num- 
ber in the before frustration section sub- 
tracted from the number in the after 
frustration section). The change rather 
than the absolute count is a more ac- 
curate measure of the elfect of the inter- 
vening frustration. 

т. Abandoning the Task. A tendency 
tQ abandon a task can be inferred from 
dischange in the number of omissions 
mai following frustration. An omission 
means that a subject refused to attempt 
to identify any part of a stimulus in the 
perceptual tasks. It should be recognized 
that a refusal to respond when the goal 
is unattainable is not necessarily an in- 
adequate mode of behavior. The individ- 
ual who correctly evaluates a situation as 
impossible may be justified in abandon- 
ing the task. Nothing would be gained 
by expending energy in a fruitless search 
for a response for which sufficient guiding 
cues are unavailable. However, to con- 
tinue to abandon the task when success 
is possible is clearly inadequate behavior. 

In the Auditory Perception task most 
subjects in both groups (28 normals and 
27 schizophrenics) made one or less omis- 
sions during the before frustration sec- 
tion (steps 1 through 6 of the prefrustra- 
tion form). When success became unlikely 
during the six most difficult steps, omis- 
sions increased, but the number of in- 
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dividuals in each group refusing to re- 
spond to one or more items remained 
approximately the same. The majority 
of the subjects (29 normals and 27 
schizophrenics) made eight or more omis- 
sions during frustration. In the after 
frustration section (steps 6 through 1 of 
the postfrustration form), however, 29 
schizophrenics (6075) increased the num- 
ber of omissions, whereas only 18 normals 
(3895) did so. (See Table 2 for the P 
values of the obtained differences be- 
tween groups.) 

In the Visual Perception task no signifi- 
cant differences. between groups were 
manifested before frustration (those items 
prior to the three consecutive failures). 
Almost all subjects (43 normals and 41 
Schizophrenics) made no complete re- 
fusals to respond. During frustration (the 
Six most difficult items) omissions in. 
creased with all but nine normals and 
fourteen schizophrenics making one/or 
more omissions. After frustration («dose 
items іп the postfrustration form 
equivalent in difficulty to the items in the 
before frustration Section) fifteen schizo- 
phrenic subjects (31%) showed an in- 
crease of two or more omissions, whereas 
only four normals (8%) showed an in- 
Crease of as many as two omissions. (See 


2 for P values.) 
The results indi 


cate that it was only 
after frustration, w 


hen the goal again be- 
came attainable (as judged by each sub- 
Јес level of performance Prior to frus- 
tration), that differences between the 
groups became evident. More Schizo- 
phrenic than normal individua], in- 
creased the number of omissions after 
frustration. Many schizophrenic subjects 
were unable to offer responses to items 
of a level of difficulty in which they had 
been successful prior to the frustrating 
experience: 


A tendency to abandon à task can also 
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be inferred from the time spent in at- 
tempting to discover a correct каро 
Each subject's average time for respons 
to the blurred words was calculated for 
each section; f the Visual Perception 
task. ТҺеѕе па] response-time Scores 
showed a great deal of variation within 
as well as among individuals. On the a 
blurred words responses were -€— 
rapidly by most subjects, whereas on t is 
more difficult items some subjects "mae i 
on trying to identify a word for as long | 


as two minutes, In the before frustra" 
section more schizophrenics (23%) - 
normals (10%) displayed extremely a 
reaction times (twenty or more secon М 
but the difference between groups 15 e 
significant. No differences were ba 
during frustration. After frastration — 
normals (46%) decreased their €— 
time spent per card, whereas 32 sehi ВА \ 
Phrenics (67%) decreased their al | 
response times. (See Table » for P ns 
These results are in accord with н 
findings regarding omissions. Thus, 4 
of the factors contributing to the lo ic 
frustration tolerance in the schizophren 
group is their tendency to withdraw eed 
the situation after having encounte 
frustration, be- 
?. Perseverative Behavior. In ry 
fore frustration section of the диш 
Perception task the number of ОР 
їп еасһ group making one or more жт 
pletely incorrect attempts to resp (29 
(guesses) was approximately the same the 
normals and 26 schizophrenics). I^ no 
after frustration section there also Wa? in 
significant difference between groups. 
the number of subjects increasing по 
number of guesses, The major port igo 
both groups (so normals and 28 resse 
phrenics) made as many or fewer e i 
in the after frustration section tha ing 
the before frustration section. DU no 
frustration, however, when virtually 


PERFORMANCE OF 


useful perceptual cues were present, the 
schizophrenic group made significantly 
more guesses than the normal group. In 
this most difficult section of the task, 11 
normals made from four tt4eight guesses, 
whereas 28 schizophrenics made from 
four to thirteen guesses. (See Table 2 for 
P values.) 

Examination of the nature of the 
guesses revealed that some guesses ap- 
peared to be perseverative errors consist- 
ing in part of words or syllables that were 
direct repetitions of responses offered 
earlier in the test. In addition the records 
show conceptual perseverative guesses— 
the perseveration of an idea rather than 
à specific syllable or word (e.g., “baseball, 
football, soccer,” or “piano, Mendelssohn, 
flute" offered in immediate succession). 
In the former example, "football" was 
classified as a perseverative error because 
haa ci repetition of the syllable 

des This response also could be 
Classified as a conceptual perseverative 
Error along with the immediately follow- 
ing term “soccer.” In the second example 
Only the last two words were classified as 
Perseverative guesses. The initial incor- 
rect response “piano,” which apparently 
Provided the cue for the later responses, 
Was classified as a nonperseverative guess. 
If one syllable of a two-syllable response 
Correctly identified part of the stimulus 
Word, the response was not classed as a 
31655 despite the fact that the incorrect 
Syllable might have been a perseveration. 
" Although somewhat more individuals 
ELE 
aet a group (157%) ms : p 
Sie ve errors in the before frustration 
cie zu the difference between groups is 

9t significant, During frustration the 

ifference was increased markedly with 

ш, кле (69%) and 18 normals 
м” making such errors. After frustra- 

15 schizophrenics (31%) and only 
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six normals (12%) manifested an increase 
in the number of perseverative guesses. 
(See Table 2 for P values.) 

Twelve schizophrenic patients made 
from four to eleven perseverative at- 
tempts, whereas only one normal made 
more than four perseverative guesses. In 
several of these extreme cases the be- 
havior during and following frustration 
resembled in some degree the fixated, 
stereotyped behavior that Maier (7) and 
others (8, 13) have described. 

While perseverative attempts did not 
appear to be directed at the goal which 
the experimenter had established, they 
cannot be considered samples of unmoti- 
vated behavior. It is important to recog- 
nize that the subjects had been told to 
guess when difficulty was encountered. 
The excessive number of perseverative 
responses made by some schizophrenic 
subjects suggests that they probably were 
cë plying mainly with the instructions 
tol yess; 1.., merely to offer a response 
had been substituted for the original goal 
of identifying the spoken word. Many 
schizophrenics continued to respond in 
this perseverative manner even when the 
spoken words were loud enough to be 
identified (as determined by their per- 
formance prior to frustration). From the 
results obtained, however, it appears that 
for the vast majority of the normals the 
instructions to guess were not substituted 
for the instructions to identify the actual 
stimulus. 

In regard to guesses in general it is of 
interest to compare the results in the 
Auditory Perception task with the find- 
ings of the Postman and Bruner study (9). 
Using an experimental and a control 
group of normals in a visual-perception 
task, Postman and Bruner subjected the 
experimental group to a large number of 
successive failures accompanied by “Ы 
ingly disruptive criticisms.” The frus- 


12 HAROLD WILENSKY 


trated normals made more guesses in- 
cluding obviously inadequate attempts 
(meaningless phrases) than the control 
group. 

The stress situation used by Postman 
and Bruner appears to have been much 
more severe than the one employed in 
the present experiment. During the mild 
failure situation the normal group made 
relatively few guesses. The schizophrenic 
group, however, reacted much more se- 
verely to the similar stress, making many 
more guesses, including the obviously in- 
adequate, perseverative attempts. These 
findings suggest that the responses of 
schizophrenics to relatively mild stress 
may resemble those of nor: 
frustration, 


3. Mode of Incorrect Response, A]. 
though omissions and guesses were errors 
which contributed to the reduction of 
Scores following failure, to make an at- 
tempt to respond when the goal is agin 
attainable should be a тоге desi ible 
form of behavior than to з 
The relative adequacy of 
of behavior can be inferred 
tionship between the mod 


mals to severe 


refuse to try. 
the two forms 
from the rela- 
€ of incorrect 


havior. No relationship is evident in thg 
schizophrenic group where the biserial 
correlation is —0.04 (sigma r, = 0.18). 
Apparently it made little difference 
whether the /¢hizophrenic patients chosi 
to omit or & guess, since many of they 
guesses were inadequate (perseverative) 
attempts. 

4. Bizarre Behavior. On the whole \ 
relatively small number of the а 
phrenic subjects and none of the norme | 
manifested any form of bizarre behania 
that could be related to the experimenta 
frustration, 

^. Nonsense Word Responses. тщ 
guage disturbances are frequent od 
comitants of schizophrenic disorders. On 
Phase of such disturbances is the we 
words that have meaning only for the E 
dividual. In the Visual Perception tas 
many normals as well as schizophrem® 
offered spelled responses that did not a 
semble meaningful words, Some st. 
Spontaneously commented that the д 
SPODSÉ was not a rea] word; others a 
mitted that the response was not а 16 
Word after being asked to define it a 
meaningless response was classed per 
nonsense word only when the subject = 
fined it in some manner or stated that i 
believed it to be a real word. The fal p 
ing are examples of nonsense words 81У 
by schizophrenic patients: 

Fronise— co, 

Enicely—jn 

Osflaze. 


Altrsit 
Figtur 


nfronting or facing. 

fringing upon property. 

—а process applied to poetry- , ' 
—a Harvard University graduation 
€—like an ashtray. 


Responses that were only slight distor 
tions. of real words and defined acco! s. 
ingly were not classed as nonsense WO” as 
The response “Oculary,” defined ар 
“something to do with the eyes,” wae cu- 
parently a distortion of the word s 
lar.” Similarly, the response "oma 


Am ” was 
defined as «4 town in Michigan, 
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presumably a distortion of Owosso which 
1s a town in that state. 

In the schizophrenic group 13 subjects 
gave a total of 85 nonsense word re- 
sponses, and defined most them. Two 
normals gave a total of thi? words that 
Were meaningless, and only one word was 
actually defined. Both normals had ob- 
tained very low Vocabulary scores. 

It had been hypothesized that schizo- 
ide would resort readily to the use 
Beton E words during and after frus- 
an it E 85 nonsense words, how- 
the ib n istributed fairly evenly among 
ELM during, and after frustration 

s of the task (26, 31, and 28 non- 
Eo respectively) suggesting that 
n deri with nonsense words was not 
Бано, A of the experimental frus- 
t ers ie he use of nonsense words for 
боон Тев appeared to be an habitual, 
hore means of dealing with the en- 

nt. 

Chay the case of perseverative guesses, 
Cipe, nonsense words may reflect at- 
wp on the part of the subject to com- 
(es with the instructions to guess. Seven 
a 3 the 13 schizophrenic subjects 
made rini such meaningless responses 
35 ps ka omissions in this task. ОЁ the 
ERI "i p subjects who were more criti- 
smaller heir responses, a considerably 
Шау. percentage (17%) made no omis- 
Neo pite making such meaningless 
à ёс; also appear to have been less 
Шале, ER. by the frustrating ex- 
eich than the psychotic individuals 

he ма тоге critical of their responses. 
related кш) о give HOEGE words 1s 
score in ges! to the size of the drop 

‘serial E schizophrenic group. The 
the онну у же coefficient between 
Size of сш nonsense words and the 
standard e drop score is —0.46, with a 

error of 0.16. 
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b. Hallucinations. Hallucinations were 
observed in three schizophrenic patients 
during the experimental sessions. In one 
instance the hallucinations appeared to 
be induced by the failures in the final 
task.? For another patient the hallucina- 
tions resulted in a complete withdrawal 
from the reality situation, When the 
spoken words became too low to identify, 
he began to carry on what appeared to be 
a radio conversation and was oblivious to 
the actual task thereafter. A third subject 
merely reported seeing "a purple band 
of light while the record was playing,” 
but there is little evidence to suggest that 
this hallucination was a consequence of 
frustration. b 

c. Fantasy. The use of fantasy to deny 
frustration. may be inferred from the 
statements of four psychotic patients at 
the conclusion of the testing situation. 
Three of these subjects denied that they 
hå failed or that they had encountered 
difz2ulty with any of the items in the 
tasks. One patient reported that he had 
made "a hundred per cent" in all the 
tasks. 

It appears then that some forms of bi- 
zarre behavior (such as hallucinations 
and fantasy) may occur as a consequence 
of relatively mild frustration in a small 
number of schizophrenic patients. Other 
forms of bizarre behavior (such as the 
use of meaningless words) are more likely 
to be habitual means of dealing with 
the environment. 

5. Report of Feelings. The descriptions 
of feelings, obtained in response to the 
question on how the subject felt when he 
had failed, were classified into two major 


2The following are excerpts from his re- 
marks after encountering failure in the Digit 
Span task: "I give up. I can't do the test. I'm 
jamming my brain. . . . Lousy IQ. I hate you, 
you bastard. So you got a higher IQ. . . . He's 
jamming me with the radio. Turn it off. Let 
me listen to the psychologist. . . ." 
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types. One fairly clear-cut category in- 
cluded responses which indicated that the 
subject recognized and accepted unpleas- 
ant feelings. The other category, consid- 
erably broader, consisted of varied de- 
fensive reactions. Included in the defen- 
sive reactions were all verbalizations in 
which the subjects directly denied any 
painful experiences, or in which they 
avoided discussing their feelings. The 
avoidance of discussion of feelings was 
accomplished in essentially three ways: 
(a) denial of ego involvement in the 
tasks, thus implying that they were not 
disturbed in any way; (b) mere descrip- 
tion of the failure situation; and (c) de- 
nial that they had failed (exclusively a 
schizophrenic mechanism), 

It was generally quite difficult for most 
subjects to express their feelings in words. 
The responses of all the normal subjects, 
however, were classifiable. Several schizo- 
phrenic subjects appeared to be beil- 
dered by the question; they appa: Апу 
did not understand what Was expected or 
could not describe their feelings, Other 
than the repetition of the question, no 
pressure was put upon the individual to 
respond. Hence, “1 don’t know” 
were not classified. 

It seems that for the Vast majority of 
the subjects the terms “failed” and 
"wrong" in conjunction with feelings 
ince most of 
including de- 
pleasant emo. 


replies 


Acceptance of Unpleasant 

I mean —. I knew = 
little stupid. (N) 

I felt that Т should have stu 
felt more willing. І wante 
wanted to open my ears 
сап", (N) . 

Depressed 
enough, (N) 


Feelings: 
How can I feel — a 


died more, I 
d to Concentrate, I 
even though you 


naturally, they меге Simple 


On the numbers I didn't mind too шшр О 
the others I felt a little ashamed. Gee w jo 
They're so easy you know — for a guy W 

aduated from high school. (N) x 
" felt hurt. I said to myself I must be stupid. 


(N) Š 
You feel nj I tried harder. (5) ни 
I didn’t just badly. I felt like weeping 


istake 

when I failed continuously, made one (mista ) 
after the other, (S) 

I have nervous heart trouble, (5) zii 

Badly, I wanted to find myself in better 
dition. (S) 2 

I can't stand it; that’s the truth, I'm trying 
(S) 


Defensive Reactions: 

It didn’t annoy me. (N) 

I didn’t feel badly about it at all. (S) - 

I haven't got anything to gain or los 
there's no reason for feeling bad. (N) 1 

Well it didn't matter to me whether E 
it right or wrong because I wasn't taking 
test for a reason. (S) : (s 

I got it wrong. I didn't know it tha 
(N) 

Just went to the next one. (S) 

I never fail. (S ight 

I couldn't AM You've got to be DB 
or commit suicide, (S) 


the 


In reporting these statements the on! 
tional qualities in the subject's pv 
and manner cannot be conveyed. In ас lly 
tion the introspective reports, ; -— 
the defensive reactions, do not reflect ny 
individual's actua] behavior in ет 
cases. For example, a normal, who ie 
any concern about his failures, еш 
several days later to ask for his wp 
Schizophrenic subject, who reported d or 
he didn't “give a damn” if he passe ing 
failed, was so severely disturbed etd 
failure items in one task that hallud 
tory behavior occurred. 8 pet 

In the schizophrenic group? 5 cou 
cent of the subjects whose responses 


jope4 
^A standard set of questions was дерһге i 
after the first five subjects in the schiZ increase 
5roup had been tested. In order о data 0 
the number of subjects, the внес ee 
nine additional schizophrenic pd group 
Pooled with the data of the experimen ta te i 
hese additional subjects had been ting 2 
Provide a source of substitutes for equa 


{wo experimental g-oups. 
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TABLE 3 
FREQUENCY or TyPES or RESPONSES TO INTERVIEW QUESTIONS 
Interview Question Type of Response Normal Schiz 
z N=48 N=57 

H 3 A Acceptance 2 2 
еты you feel when you faile Defensive 35 28 
something wrong? “Don’t Know" 3 
No Reply t 
| Not Questioned $ 
Average or Above 8 27 
How А е Below Average 20 17 
do you think you made out? “Don’t Know" I 5 
No Reply 3 
Not Questioned 5 
» Digit Span 2 8 
Which sv. . Benton 26 15 
ch was the easiest test? Auditory Perception 17 = 
Visual Perception 3 6 

No Decision 6 

Not Questioned 3 

Digit Span 24 17 

Whi " Benton 2 тї 
ch was the hardest test? Auditory Perception 2 4 
Visual Perception 20 16 

No Decision 6 

Not Questioned 3 


~ Paian tended to react defensively. 
acted dels mal group only 33 per cent re- 
bent ensively. The numbers of sub- 
3. A each category are shown in Table 
де, hisquare test of the difference be- 
of ina? "wes in regard to the number 
imos iduals in the dacepronce and de- 
the би categories is significant between 
6. га .02 levels of confidence. 
ы о] Level of Performance. A 
obtained y ae cti his performance was 
tion: “H rom his response to the ques- 
The sig do you think you made out? 
8гоцр r evaluations in the schizophrenic 
the ie from complete denial of 
in an d шапан а hundred per cent 
Performa them ) to admission of poor 
he Жеш], (“I think I made out bad ). 
Estimates als were less grandiose in their 
E. Са = which ranged from a high of 
“Pretty TABS maybe a little above,” to 
crummy.” 
N order to permit comparison of the 


resp, 
Onses a 
€s of the two groups, the esti- 


mass were divided into two categories: 
querase or above included statements 
which suggested that the individuals be- 
lieved they had made an "average" or a 
"fair" or at least a "not too bad" score, 
below average included all statements 
which suggested that the subjects were 
critical of their performance. 

More schizophrenic subjects (61 per 
cent of those whose responses could be 
classified) than normals (88 per cent) es- 
timated their performance at the average 
or above level. A chi-square test of the 
difference between groups in regard to 
the number of individuals in the two 
categories is significant between the .o2 
and .о5 levels of confidence. The num- 
ber of subjects in each category is shown 
in Table 3. 

7. Difficulty of the Tasks. Only a few 
subjects explained the basis of their rat- 
ings of task difficulty. Their comments 
suggest that the number of tailures en- 
countered was probably a major factor 
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in influencing the ratings. In several in- 
stances, as the following comments indi- 
cate, task difficulty was judged by com- 
paring the number of failures in the dif- 
ferent tasks: 


They seemed equally hard, but I think I 
missed more on the numbers, 


I only missed out on about thre 


e drawings 
so they would be the easiest, 


Other comments Suggested that the 
subject had anticipated better perform- 
ance (i.e., fewer failures) in that particu- 
lar task because of his specific needs: 


I know I have very good eyesight, and I 
don't know Why I couldn't read them (the 
blurred words). 


The numbers for me . . . I felt it would be 
rather easy to remember them. 

The ratings of the four tasks are shown 
in Table 3. The Digit Span and Visual 
Perception tasks appear to be the most 
difficult; the Benton and Auditory Per- 
ceptions tasks were rated most frequently 
as the easiest. The groups are in sfose 
agreement except for the Benton, 
was rated as most difficul 


phrenics but by only 2 normals. The fact 
that the schizophrenic group performed 
more poorly in this task than the normal 


group tends to add credence to the 
judgments, 


8. Aggressive Reactions. 
testing situation several schiz 
tients made hostile comme: 
chotic individual, the оп] 
refused to continue with 


encountering failure, was frankly criti- 
cal of the examiner, Via his hallucina- 
tions one schizophrenic directed 
gression at the "voice." 
ures a third patient wa 
gist to “watch out for t 
Bet it stuck; it's sharp," Among the пог- 
mals there were no obvious expressions 
of aggression directed at the examiner, 
During the experimental session their 
comments consisted mainly of self-critj- 


“ich 
t by 11 schizo- 


During the 
ophrenic pa- 
nts, One psy- 
y subject who 
the tasks after 


his ag- 
' In between fail- 
ted the psycholo- 
he pen. You might 
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cisms and rationalizations for ши 
Even at the conclusion of the E 
mental battery, when asked аа 
opinion of the tests, direct vins de 
sponses werd rare. Three gc jid." 
scribed thef/fests as "silly" or ie T 
One psychotic subject thought pee 
were "very dead, dull"; another re hos- 
to continue with the tasks йош ir 
tile remarks at the experimenter. A | B 
psychotic patient initially d his 
approval, but apparently projecte who 
criticism adding: “For someone hey 
didn’t understand, he would think t 
were foolish,” j ion, 
In general the replies to the pe 
"What did you think of the tests, "d 
$0 varied in content that it was а to 
sible to categorize the responses ейи 
compare the groups with respect to ете 
For the most part the opinions sê asive 
to be of a positive but somewhat ойр 
nature. Many subjects їп both pt P 
thought that the tests were “all rmals 
or "interesting." Among the noi 
Such statements were freq uently d know 
by stating that they really didn чей е 
Ше purpose of the tests. Others amory” 
merely- to describe the tasks as A on 
or “intelligence tests,” or commen opi™ 
the difficulty without offering апу 
ions. прег 
After encountering the large b ар: 
of failures that these persons ha "majo 
Pears highly improbable that the „ШУ 
ity of the subjects in both grouP ге very 
could have felt that the tests es psy” 
800d or interesting, or that (as v very 
chotic put i) "I enjoyed the 
much." ituatio? 
Apparently the experimental A expe" 
Was not conducive to the outwar s. ThE 
sion of hostile or aggressive -— rep 
fact that the experimenter proba the P* 
resented an authority figure to the і 
tients may have, contributed to 
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hibition of such feelings. The effect of 
the presence of the experimenter on the 
inhibition of the expression of anger is 
demonstrated in an experiment by Dem- 
bo, which Koffka (6) has а уіеа. 
In a situation where асу ession is in- 
appropriate Katz (5) points out that 
masking, or camouflaging behavior (in- 
creased politeness, affected indifference, 
etc.) serve to conceal from the experi- 
menter the vulnerability of the thwarted 
person: his emotional tension, ego injury 
(feelings of inferiority, shame, wounded 
Pride, etc.), and punishable impulses 
(such as ageression).” 
b In the opinions of the tests expressed 
у both the schizophrenics and the nor- 
| Shea behavior seemed to pre- 
did gn ate. However, most of the normals 
Side attempt to conceal emotional 
Shane Aui ego injury when questioned 
«eir e heir feelings during failure and 
the — of their performance. On 
ни сг hand, despite their grossly in- 
а ч performance after frustration, 
al of the schizophrenic patients at- 
Pted to conceal emotional disturb- 
ance, 
er ub im who accepted unpleas- 
ust angs appeared to be blaming 
tions ves for their failures. Under con- 
of failure due to lack of ability, 
more (11) states that inwardly di- 
hittin is warranted and can be 
Eilon, е an adequate reaction to frus- 
dition he present experimental con- 
were such that the subjects could 


be expected to see themselves as instru- 
mental in their failures. Thus, the more 
frequent reports of acceptance of self- 
blame among the normals indicate that 
in this respect, too, they reacted more 
adequately to frustration than the schizo- 
phrenics. 


C. CUMULATIVE EFFECT OF FRUSTRATION 


In order to determine the cumulative 
effect of frustration on the prefrustration 
scores of each of the four tasks and also 
on the drop scores, the raw scores in 
each task distribution were converted to 
T scores with a mean of fifty and a stand- 
ard deviation of ten. Each subject’s T 
scores then were arranged in a row ac- 
cording to the position in "which the 
task was administered regardless of the 
nature of the task. An analysis of vari- 
ance technique was employed to discover 
if any differences due to the position of 
théNask existed in either the prefrustra- 
tiot: cores or the drop scores of either 
group. The converted mean scores are 
presented in Table 4. Since the distribu- 
tions of the two groups were treated in- 
dependently, the differences between 
them are not reflected in the converted 
means. 

For both groups the between positions 
variance ratios of the prefrustration 
scores and the drop scores were statisti- 
cally insignificant. It was only in the pre- 
frustration scores of the normal group 
that the variance ratio was above unity 
(1.10). Inspection of the converted mean 


TABLE 4 
E CONVERTED MEAN SCORES (T ScoRES) IN THE Four POSITIONS 
1st 2nd зга 4th 
Group Position Position Position Position 
Pref 7 
P rior tation Normal 51-73 49-77 50.15 48.12 
D ance Scores Schizophrenic 50.27 50.06 50.31 49.65 
го 
Р 5согев Normal 51.40 48.85 49.71 50.15 
Schizophrenic 50.15 48.25 51.02 50.77 
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scores, however, reveals the suggestion of 
a trend towards a decrease in the normal 
group's prefrustration performances as 
the number of tasks increased. Since a 
cumulative effect was anticipated, a di- 
rect comparison between the prefrustra- 
tion scores in the first and final (fourth) 
positions is justified. In the normal 
group the ¢ test for the difference be- 
tween means in the first and fourth po- 
sitions approaches Significance at the .o8 
level of confidence. In the schizophrenic 
group the difference between the extreme 
positions of the prefrustration scores is 
well within chance limits; the four pre- 


frustration scores remained fair] 


y con- 
stant, 


Although the results concerning the 
cumulative effect of successive frustr: 
ing experiences are not decisiv 
cast doubt upon the hypot 
schizophrenics show progressiv: 
frustration that are greater 
manifested by normals. As t 
of separate tasks in which fru 
encountered increased, 
on the prefrustration 


at- 
& they do 
hesis that 
€ effects of 
than tose 
he mhber 
Stration was 
a depressing effect 
performances of 


The Purpose of this experiment was 
to measure and to ¢ 


ompare the effects of 
frustration on the performance of schizo- 
phrenic and normal individuals, Two 
Sroups, 48 schizophrenic patients and 48 
normals, were matched Approximately for 


age, intelligence, and education, The in- 
dividuals in both 


to frustration 


memory, visual memory 
ception, and visual 
tion was sai 


sequent items of t 
by virtue of the increasin 


the normals (but not on the a 
tion performances of the schizophreni ce 
was noted, This may reflect a pops 
on the part of some normals to pre) 
wholeheart By in tasks where failu se 
seems пе е suggesting a decrea 
in their motivational level. | ЕЕ 
Jenkins (4) believes that ni 
have undergone a greater number A ps 
trations in real life than Мет асое 
basing his reasoning on studies w I 
have shown that schizophrenics odi 
group have had little success pesa MES 
many frustrations in family life, но 
appears likely that as а result ~ inst 
phrenics have developed defenses АЕ ai 
frustration such as withdrawal о pilure 
doning the task, fantasy to deny navigh 
experiences, and perseverative beha ice. 
Which serve as tension-reducing pe na- 
Hence, despite the grossly inadequa with 
ture of such mechanisms in coping се 
the reality situation, they may protec mo- 
individual to some extent from he vind 
tionally disruptive effects of frustra 
experiences, 


III. SUMMARY AND CONCLUSIONS 


alent 
Each 


a iiv 
task consisted of two equ 
forms; 


re 
items within each form 2 m 
graded in difficulty. When aei criti 
curred, it was pointed out pet 
cal comment, Measures of the 2 d 
performance on the form adminis at 
Prior to failure and on the Бли ob 
alternate form following failure WE t 
tained. The difference between ge 
Scores so obtained was employed “ivi 
measure of the adequacy of the i" 
ual's Tesponse to frustration. T diff 
Since attention and cae renic 
culties are characteristics of schizoph^. е 
behavior, it w 


i 
term 

as necessary to de 

if merely the 


е woule 
length of the tasks W 


-formance 
cause a decrement in the performé 


v 


-— 


a 


` PERFORMANCE 


сеа А preliminary group 
fo dis "ci ae subjects was subjected 
mintmal "inl сагча under conditions ol 
cessive ee run, The number of suc- 
jects were "nn pas reducedtand the sub- 
results indi - informed c errors. The 
in ——- feed that no change occurred 
ond Tei се from the first to the sec- 
mure of each task, and that no 
enw. ig ger effects were evi- 
with the 2 the results ате consistent 
Ere aeg. arm that any changes in 
may be aes the experimental groups 
the ex ther buted to the introduction of 
< xperimental variable. 
кы Soo tasks the mild stress 
some d was sufficient to reduce to 
and "e RAE the scores of the normals, 
осе at iore ei greater degree, also 
ceptual fa s schizophrenics. In the per- 
P carles diee normals werc able to 
spite the t is level of performance ае 
Бете seseryeriiug failures; the schizo- 
Wooten ; an not. Thus, the consistently 
group ЕП formance of the schizophrenic 
with m owing frustration as compared 
group n performance of „е normal 
Wie aoe the hypothesis that schizo- 
ance is ive a lower frustration toler- 
Те than normals. 
потоа also differed quali- 
tions to ент the normals in their reac 
frustrati bustratibu. After encounters 
a Sois the schizophrenics manifested 
by ne tondengy to abandon the tasks 
èss nn to: respond and by spending 
"ior die c items. Although during the 
ception ra section of the Auditory Per- 
Many the psychotic group made 
these gue a guesses than the normals, 
Dative se were to a large extent ofa 
incly fresh o nature rather than genu- 
Irustratio 1 attempts at solution. Alter 
able as nd when the task was again solv- 
ance filer ged by the subjects perform- 
r to failure, significantly more 
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schizophrenics than normals made per- 
severative guesses. 

Within the normal group those indi- 
viduals who preferred to make an at- 
tempt to respond, even though incor- 
rectly, rather than omit after having en- 
countered frustration, tended to perform 
more adequately than those normals who 
made more omissions than guesses. For 
the schizophrenics, however, it made lit- 

tle difference whether they refused to of- 
fer responses OF guessed, since many of 
their guesses were perseverative attempts. 
In respect to the greater number of 
guesses, including many inadequate at- 
tempts, the reaction of the schizophrenics 
to relatively mild stress resembles some- 
what the behavior of severely frustrated 
normals. 

Some forms of bizarre behavior (such 
as hallucinations and fantasy) occurred 
as a consequence of frustration in a small 
nibXber of schizophrenic patients. Other 
for: of bizarre behavior (such as the use 
of nonsense words) appeared to be habit- 
ual means of dealing with the environ- 
ment. 

The normals were more ready to admit 
poor performance and the presence of 
unpleasant feelings (shame, depression, 
self-blame, etc.) accompanying failure 
than were the schizophrenics. Under 
conditions of failure due to lack of abil- 
ity, self-criticism is probably a more ade- 
e reaction to frustration than at 
1 emotional disturbance. 


quat 


tempts to concea 
The experimental situation was not 


conducive to the overt expression of ag- 
gression. Hostile remarks were rare in 
both groups. Despite the large number of 
failures encountered, most subjects in 
both groups made polite comments of ap- 
proval when asked for their opinions of 
the experimental tests. 

As the number of tasks in which frus- 
tration was encountered increased, the 
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normals manifested a trend in the direc- 
tion of a progressive decrease in their 
prefrustration performances in the four 
tasks. The suggested cumulative effect of 
successive frustrations may reflect a low- 
ered motivational level, Although the 
schizophrenics were less able to cope ade- 
quately with frustration within each 
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task, their prefrustration scores in the 
four tasks remained fairly constant 
throughout. The inadequate reactions ds 
the schizophrenics to frustration (such а 
withdrawal 72d perseveration) may ке. 
as tension-réjjucing mechanisms so that 
continuing effects of frustration were not 
apparent, 
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Parents’ Attitudes vs. Adolescent Hostility 
in the Determination of Adolescents’ 
Sociopolitical Attitudes* 


Kenneth Helfant? 
‘The Rye Public Schools, Rye, New York 


Ж І. INTRODUCTION 
е pri є 
lief а present study began with the be- 
1 x "I А 
ся " sociopolitical attitudes are the 
Sonali of a complex interweaving of per- 
i т 
prob and social factors, but that 
a i є 
the ly in most cases social factors are 
tte fee important of the two. 
practi ring the scope of the study within 
With icable limits it was decided to deal 
of dels particular age group—children 
oles ; 
be s escent age. Young people of this 
r Toi б 
е striving for self-expression, but 
1 
Ta 
have soe grateful to the many people who 
ощ of TUE ma in the planning and carrying 
» 5 study, 
rofess 
йр MON Goodwin Watson and S. Stansfeld 
to orga, меге especially helpful in helping me 
periment S my thoughts and design the ex- 
koope „ДА, the collection of the data the 
and OMA of the principals, teachers, students, 
ions qd of Teaneck, Bergenfield, and Du- 
to giv igh Schools in New Jersey was such as 
Worthy The added incentive to produce results 
ing Gu ad their efforts in my behalf. In analyz- 
orge writing up the results Professor Irving 
which pave advice and stimulation without 
full won WOuld have been unable to realize the 
ре ийсапса of the data. 
lop fon 4 thanks are due to Miss Anne McKil- 
the ma ner repeated reading and rereading of 
board RUE providing me with a sounding 
Ticheq tom which my ideas were reflected en- 


by h 
ет с ructiv itici: ogent 
Suggestions, onstructive criticisms and cogi 


Submi : 
Quir, mitted in partial fulfillment of the re- 


e " 
Oph ments for the degree of Doctor of Philos- 


y, in ү i т 
niversity, ween of Philosophy, Columbia 


they are still strongly influenced by the 
ties of home and family. 

The scope of the study was further 
limited by centering upon a comparison 
of two relationships: (a) the relationship 
between a particular social factor (par- 
ents’ sociopolitical attitudes) and ado- 
lescents’ sociopolitical attitudes; and (b) 
iL eni: between a particular per- 
sol, lity factor (adolescents’ personal 
feelings of outwardly-directed hostility) 
and adolescents’ sociopolitical attitudes. 
On the basis of existing studies in the 
feld, it was decided that probably the 
most potent social force contributing to 
the sociopolitical attitudes of adolescents 
is the sociopolitical attitudes of their 
parents, and that probably the most 
potent personality factor influencing 
sociopolitical attitudes of adolescents is 
their personal feeling of outwardly- 
directed hostility, which finds expression, 
through the mechanism of displacement, 
in sociopolitical attitudes. 

The particular sociopolitical attitudes 


selected for study were attitudes toward 
Russia, attitudes toward international 
relations in general, and attitudes toward 
war. Attitudes toward Russia were se- 
lected for study because relations with 
that country were at the time in the 
forefront of public discussion. For the 
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same reason, however, it was thought that 
attitudes toward Russia might represent 
a special case, and not adequately reflect 
more general underlying factors in аш- 
tude formation. For this reason, in addi- 
tion to attitudes toward Russia, study 
was given to attitudes 
national relations in 
toward war. 

So limited, the study 
hypotheses: 


1. Adolescents’ attitudes toward Russia, 
international relations, and war are sig- 
nificantly related to: 

a. The attitudes of the adolescents' 
parents on the same topics. 

b. The adolescents’ personal feelings of 
outwardly-directed hostility. 

2. Adolescents’ attitudes toward Rus- 
sia, international relations, and war are 
more closely related to the attitudes of 
the adolescents’ parents on the ѕа ле 
topics than to the adolescents’ pergal 
feelings of outwardly-directed hostility. 


toward 
general, 


inter- 


and 


presents these 


II. SUBJECTS, INSTRUMENTS, AND 
PROCEDURES 


The overall plan of this experiment 
was to give a battery of attitude scales 
and personality tests to а group of high- 
school seniors, and then to give the same 
battery of attitude Scales (but not the 
personality tests) to their parents. The 
correlations between attitudes of parents 
and of children were then calculated, as 
were the correlations between the atti- 
tudes of children and the factor 


ured by the personality tests ( 
feelings of outw 


meas- 


personal 
ardly-directed hostility) 


A. SunJECTS 
Teaneck High School, 
homogeneous upper 


munity of Teaneck, in 
Jersey, 


located in the 
middle-class com- 


northeastern New 
was selected as the locale for this 
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experiment. Nine regular senior rae 
їп American history (212 iege 
judged by the high-school ning ait 
the teache” «of the classes to be r ae 
sentative һе entire senior class ч 
students), were used as the om 
sample. Forty-six students were е » 
nated because their parents could r : 
be reached or because of failure to pa 
plete the tests. The final sample а 
sisted of the remaining 166 spares 
seniors (84 boys and 82 girls)-and : "à 
parents (165 mothers, and 165 fathe 


B. INSTRUMENTS 


The Attitude Scales 


For the purposes of this study ps 
cept Chein's definition of an agua cts, 
“a disposition to evaluate certain obje ©” 
actions, and situations in certain Way 
(1, р. 177). 


„1:е[$ 

1. A Survey of Opinions and M 
about Russia. Originally it was hol at 
that the С. Н. Smith scale for the А 
urement of attitudes toward eae 
might be used for this study, but jp 
found, when the Smith scale was o» be 
to a pilot group, that there renden e 
a piling up of scores at the lier the 
favorable toward Russia) end la on- 
scale. А new scale was Шеге О 
structed by the experimenter, hacen ^ 
to the Likert technique of очен 
construction. The scale, which inclut is 
items from the original Smith scale 
reproduced below. „in 

As a check on internal conser? g 
addition to the usual steps in на tech- 
struction according to the Likert to an 
nique, the final scale was subjected tho 
item analysis. The splitgroup me were 
Was used, and all items of the scale ¥ the 
found to differentiate the high he hree 
low Scoring group for each of the 
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A SURVEY OF OPINIONS AND BELIEFS ABOUT RUSSIA* 


DIRECTION 

: NS: Indicate y H 

priate e your feeling about еа h ; . " 
column. Be sure to put a check after 5 ан by putting a check (У) in the appro- 


Strongly | : 
D | Aj d Agree Don't Dis- | Strongly 
Ag Know agree Di: *€ 
1. In my opini > | E ISagrem 
honestl pinion, the Russian leaders will | 5| 4 3 
ар у support a United Nations plan | | Ш t 
% 1 күз the peace....... | | 
а — | | | 
И of mankind 5 еа Russia is the curse 1 2i з z1 F 
is ii dou SUE 0 GR BEN cus ceres | | 
loingithi belief that Russia's ways of 5 1 3 Е 
a ings are quite as good as ours.... Ё ^ 
fen friendly toward Russia. ... =| j s s 1 
. The QS y NAFI КШ өчө egni 
ао аат form of government makes 1 | 2 3 
© Dene ue SE peapie | 9 3 
that the U.S. should tell R г| z| 5 1 
| 5 
| | 
| | 
5 4 3 2 i 
| 
1 2 3 4 5 
| 
| | 
1 2 3 1| " 
4 3 2 1 
° 3 4 5 
1 2 3 4 5 
Га 4 3 2 1 
14. I like LU | 
Шке a койа suia ees pet 
i ас more things about Stalin than I Е * 3 z П 
ак that trying io get along with | ы * * 5 
16, belie is a waste of time. у а +X 
sincerely ina the Russian leaders are | E E з | $ : 
common RS Std in the welfare of the | 
Eo = | | | i | | 
after each item were not in the scale when it was 
i to a check in that box. 


he s 
hi inte Каран which appear in the boxes г 
an y Core indi e subjects of the experiment, but in 
unfriend] icates a friendly attitude toward the var 
y attitute toward the variable. 


dicate the score given 


iable being measured, while a low score indicates 


lated by the split-half method. The 


correlation coefficients so obtained, when 
the Spearman-Brown 


Brou 
ps 
(students, mothers, and fathers). 


S 
a fur 
ther check on validity, the stu- 


ents ; 
ikea E b experimental group were corrected by 
“Чіа on вешае their attitude toward prophecy formula, were .92 for the stu- 
tion inc linear scale, and the correla- dents, .86 for mothers, and .89 for 
le attitude в self-ratings and score on fathers. 
scale was found to be .78- 
2. Survey of Opinions and Beliefs 


е reliabili à 
eliability of the scale was calcu- 
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about International Relations. An a 


tude of hostility in international rela- 


tions is defined as being indicated 
strong tendencies to criticize, reject, 


coerce foreign countries or peoples, and addition t 


feelings that we should take a more m 
tant stand in international relations, 


scale to measure such feelings was con- 


A SURVEY OF OPINIO 


DIRECTIONS: Indicate your feelin: 


g about 
priate column. Be sure to put a chec 


tti- structed by the experimenter according 
to the Likert technique of attitude-scale 
by construction..[t is reproduced below. 1 

or As а che on internal consistency, in 
{ће usual steps in scale con- 
ili- struction according to the Likert tech- 
A nique, the final scale was subjected to 
item analysis, The splitgroup metho 


NS AND BELIEFS ABOUT INTERNATIONAL RELATIONS* 


1. In my opinion, the United States should 
give up trying to be on friendly terms 
with other countries... L... S 

2. I think that if the United States is 
friendly toward other countries they are 
not as likely to be aggre: 

3. In my opinion, only foolish dreamers be- 
lieve that international 
accomplish anything i 
World. ...5.4. 


just plain common sense to "love thy |” 


98, 
5. I believe that the U.S. should send foots 4 


them 


In my opinion, international good will iz 
Gssential to the welfare of t Ini 
States... bod, LIETI TE о ted pig 

9. Ed. my belief that 

with any country that tries to take ad- 
vantage of the United States 


national Problems... |. 
15. It is my belief that other n 
ten plotting against us, 


16. In my opinion, all sensible people be- 


lieve in trying to be friendly with other 
countries 


Р го- 
each statement by putting a check (4/) in the арр 
k after every statement. — 
» ly 
Strongly Don't Dis- БОО 
Б ВЕ 
Agree | Agree Know agree | Disagr 
5 
1 2 3 4 
M 1 
5 4 3 ы 
оз сет ee 
1 ° 3 
C B FEN. —— 
n 3 2 
| 
5 4 3 2 
[ТЖ m [T xu 
2 3 
5 
1 2 3 4 
1 
5 4 3 2 
5 
1 2 3 4 
1 
$ 2 3 4 
1 
5 4 3 2 
1 
5 1 i 2 
Е) El 
1 2 з 4 
== 
5 € 3 2 
5 
1 2 з 4 
1 
5 " 3 2 
ea 
I | p 
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wa: 7 
fo s used, and all items of the scale were 
u A à à 
im to differentiate the high from the 
Scoring group for E f the three 


Em che A n validity, 
‘ice ask “4 in the experih ental group 
toward ed to estimate their attitude 
oe pec relations on а 
self-rating ly and the correlation between 
scale - s and score on the attitude 
TL + found to be .70. 
be к of the scale was calcu- 
iver’ the split-half method. The 
rected b ск че so obtained (cor- 
were 8 y i ne Spearman-Brown formula) 
апа 2 or students, .71 for mothers, 
‘81 for fathers. 


nee of Attitudes Toward War. 

entiatin, € consisted of the 16 most differ- 
айарга items from _Likert's 18-item 
Stone ate of the original Droba-Thur- 
1€ gee eene scale (2). The 
termined ree items were de- 
а pilot у giving the 18-item scale to 
analysis A and conducting ап item 
rom Lk the results. The two items 
eliminar TE adaptation which were 
entiating because of their low differ- 
Banizatic power were Items 4 (“An gn 
to estab Я of all nations is imperative 
ablish peace") and 6 ("War brings 


misery to millions who have no voice in 
its declaration"). 

The following are representative items 
from the scale: "The benefits of war out- 
weigh its attendant evils,” "In the su- 
preme offer of his life on the battlefield, 
a man attains to the greatest heights of 
glory,” “It is our duty to serve in a de- 
fensive war,” “It is the moral duty of the 
individual to refuse to participate in any 
way in any war, no matter what the 
cause.” 

The reliability of the attitude-toward- 
war scale was determined by the split- 
half method (corrected by the Spearman- 
Brown formula) and found to be .77 for 
the students, .59 for the mothers, and .49 


for the fathers. 


4. Intercorrelations Among Attitude- 

ale Scores. Table 1 presents the inter- 
correlations between the various scale 
sé. s for adolescents, mothers, and 
fathers respectively. In every case, a high 
score on the attitude scales indicated a 
friendly feeling toward the country, idea, 
or institution involved. 

As can be seen from Table 1, the 
intercorrelations between. the scales are 
all low. The intercorrelations are highest. 
for the adolescents (absolute average 


TABLE I 


UDE SCALES 


INTRAGROUP CORRELATIONS AMONG SCORES ON THE ATTIT 
Friendliness in Approval 

а, Attitude Int'l Rel's of War 
= * 

Students Approval of Russia 30" ‚26 
an. * 

Friendliness in Int'l Rel’s +29 

Mothers Approval of Russia i —.10 

Friendliness in Int'l Rel's —.05 Ы 

ETT. 

ар Approval of Russia .28* 16 
Friendliness in Int'l Rel's = .05 


* Si К 
Snificant at „og level. 
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т = .28), next for the fathers (absolute 
average т = .15), and lowest for the 
mothers (absolute average r — .11). Ado- 
lescent attitudes of friendliness in inter- 
national relations and approval of war 
are negatively related to a statistically 
significant degree (r — —.29), while the 
correlations between these two attitudes 
for mothers and fathers show that their 
attitudes on these topics are unrelated 
(т = —.o5 in both cases). T he differences 
between the correlations, attitude of 
friendliness in international relations vs. 
attitude of approval of war for mothers 
and fathers, as compared. with that for 
adolescents, are significant at the -05 
level. There are no gross discrepancies 
in the intercorrelations between the 
scales, inasmch as the signs of the corre- 
lation coefficients are all wh 
expect if the scales are mea 
they purport to measure. 


at we would 
suring what 

dp. 
E 
Measures of Students’ Personal Fee 


lings 
of O utwardly-Directed Hostilit 


y 


For the purposes of this study, per- 


sonal feelings of outwardly-directed hos. 
tility are defined as strong tendencies to 
criticize, rebe] against, coerce, or reject 
persons or things; feelings that one must 
fight to get along, that one would like 
to destroy or mutilate objects or persons 
In one's environment, that offense is а 


the following 
used: (a) a question 


projective type (the Like-Dislike Scale), 


adapted from a part of the Interests and 


used by the 
Ssociation іп 
ght Year Study; 


and (b) the Rosenzweig Picture-Frustra- 


tion Study. 


HELFANT 


1. The Study of Likes and Dislikes. 
The 34 items from the original о. 
апа Activitig Questionnaire of m d 
gressive Edi ноп Association (6) W e а 
were designéd to measure A 
thoughts and actions were ieee 
with 66 other items which were eri 
fillers. Instead of asking students to mar - 
the items оп а three-point scale pne 
—Dislike), as in the original qu 
naire, a five-point scale (Like very ert 
—Like~?—Dislike—Dislike much) 
was used. 


very 


Following are some representative 
items which when marked "Like koi 
much" (L+) or "Like" (L) were im 
sidered to indicate feelings of outwar@y” 
directed hostility: “Throwing spit send 
"Watching a good fight," “Picking som 
body’s argument to pieces,” “Looking р 
pictures of death and destruction. for 

The odd-even reliability coefficient ie 
the relevant items of the Lien 
Scale was found to be .88 (corrected l 
Spearman-Brown formula) 


| : " ation 
2. Rosenzweig Picture-Frustra 


, 
Study. This test was first described M 
Rosenzweig in 1945 (4). It pepe lly 
24 cartoons depicting people in a ПШ 
frustrating situations апа requires he 
testee to fill in the “balloon” above t 
frustrated person. 

The following 
tions depicted in 


А itua- 
are some typical sit 


the cartoons to a 
the subjects are asked to respond: ~ 
The driver of an automobile is ae 
sizing to а pedestrian for di 
Splashed the latter's clothing — 

#1), (b) A customer is complaining ew 
à clerk that she has brought back a ec 
Watch three times now because it refus is 
to go (cartoon #5), (c) A wee a 
apologizing to her partner in a к 
game for having made a stupid P 


ay 


ADOLESCENT 


ES dag I А man returning a 
tak. the eee explains apologetically 
eie x caused the damage (car- 
are as nar шешш 1: OF the test 
ga S Each of V9 following 
One ая ontains two or more people. 
mala ү is always shown talking to 
empty sp: пх н АКЕП pe WTE the 
comes ча a = ie teply that 
е i your mind. Avoid being 
TI i Vork as fast as you can." 
iis М = a were scored accord- 
aweig et се given by Rosen- 
Punitive sex : (5), but only the extra- 
oË this и. was used for the purposes 
extrapuniti = y. Rosenzweig describes 
ъа lye responses as follows (3): 
Minh ae ee responses are those in 
tributes " individual aggressively at- 
— Ae Isis to external per- 
are an ыу The associated emotions 
Th Бе => resentment. 
Л elation between scores on the 
scöres ы and the extrapunitive 
39, it ан calculated and found to be 
Шош їсайп& a statistically significant, 
etw not high, degree of community 
en the two instruments. 


Me > 
Теаѕите of Student Intelligence 


a a previous studies have found 
gence Ж. relationship between intelli- 
it hax the internationalist point of view, 
gence а that a measure of intelli- 
certain € be included in order to be 
Sontoundine this relationship was по 
Study "Y ing the relationships under 
yn; 20-word vocabulary test adapted 

telligeng Thorndike from the LE.R. - 
Ore ie Scale: C.A.V.D. (8) was there- 

inistered to all student subjects- 


Me 
asure, A Е 
res of Certain Background Factors 


Th 
lain ^ Parent Interview. In order to ob- 
urther qualitative and quantitative 
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information about the subjects of this 
experiment, a parent-interview form was 
constructed by the experimenter for use 
in interviews with parents of the ado- 
lescents. The parent-interview form was 
designed to give measures of: (а) amount 
about. international re- 
the 


of conversation 
lations that goes on in the home in 
presence of the children: (0) amount of 
parental contact with other countries; 
(c) amount of parental and adolescent 
church attendance; (d) parental attitude 
toward the attitude scales; and (e) par- 
ental economic position. Items (а), (0), 
(с), апа (е) above were assigned numeri- 
cal indices on the basis of the answers 
iven to the relevant questions in each 


case.* 

A quantitative measure of the relia- 
bility of the parents' answers to the ques- 
nterview form was 


tions on the parent! 
ryt obtained. The subjective impression 
imenter and of the other in- 


ойле exper! 
térviewers was that parents had no diff- 


culty or resistance in accurately answer- 
ing the questions. 


C. PROCEDURE 

The students were given all the scales 
and tests listed. above (with the excep- 
tion, of course, of the parent-interview 
[orm) during their regular classes in 
American history. Two full class periods 
of 5o minutes each were required to 
complete the testing of the students. All 
student testing was done by the experr 
menter. The students were urged to fill 
out all scales and tests as frankly as possi- 
ble, and assured that the results would 
not affect their school grades or records 
in any way. In order to further insure 

3 A copy of the parent-interview form and an 
explanation of the scoring system appear in 


Appendix A. А 
+The replies to item 
and appear in Appendix В. 


(а) were categorized 
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frank answers, students were not re- 
quired to put their names on any of the 
scales or tests, but they were identified 
by means of a coding system. 

The parents of the students were inter- 
viewed individually in their homes. Dur- 
ing the course of the interview they were 
given the attitude scales, which 
filled out themselves in the presence of 
the interviewer, After the attitude scales 
had been filled out and interviewers had 
checked them to see that all item 
answered, 


they 


5 were 
the parents were asked the 
questions on the Parent-interview form, 
the interviewer writing down the 
answers. The interviewing was done by 
the experimenter 


ology, Graduate 
University, 
The experimenter met 


Purposes (aa 
etail, A stand- 


Variable 


HELFANT 


ard method for conducting the inter- 
views was agreed upon, and while p 
interviewing was going on, perio d 
meetings w' held to discuss any pro 3 
lems that ?4me up. The a 
went along to at least one of the me 
views conducted by each interviewer 4 
be certain that the agreed-upon - 

ardized procedure was being followed. 


ПІ. ANALYSIS OF THE DATA 


Because the hypotheses which © 
study was designed to test (sce С К: 
involve measurement of degree as um 
kinds of relationships, it was deci " 
that a correlational method of айар 
Was most appropriate. Table 2 ia 
the intercorrelations and the means а һ 
standard deviations of the scores on pes 
of the major tests and scales "wee. 
tered to the 166 high-school seniors k^ 
their parents (165 mothers and 
fathers) 


а s of 
The differences among the mean 


11 
Es 16: | | — 
T. Student approy. l of 
Russia. UE. 200? 
2. Mothe: —.05 
Russia ы 
3. Еа{һе е» 
Russi, 102 
Ludent itude of m 
friendliness in Int'l * 
Tera mue н! ae) 288 
5 Mothers" attitude of п *| —.29* — 164] — cce 
friendliness in Ти Se | SR кчө чо 
Rel’s —.10 
„ Fathers’ attitude of ы =- i 
friendliness in “tnt Memes] шю 
Кез. —.06 
WES] сит | —.es m 12 
6*| 
B 116% o5 ы oH 
ayo | =” 
.16*| А jöt 
—.o 
.39* 
т 
37-5 | з5.6 | ева 6 8.2 | 533 
E 59.5 | 56.8 Е 8. 4 | 88. 15 
7 9.2 8.т 6.6 8:4 13 ages 4 17.6 
i Correlations which are significant at 
ni 


Ш 
the , 4 
cance for this study) are marked with an ОЎУ of Confidence (whic 


an asterisk, 


ig 
istical 8 
h has been adopted as the level of statis 


y 
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чы panes of parents and adolescents are 
| atistically significant for any of 
the attitude scores. Тһе, differences 
bord the standard ex ns of the 
E cures of student’ ‘and their 
Ail tee hs statistically significant? for 
ии 12 attitudes measured. The 
Rua 3 etween tbe standard devia- 
bs hs he students and fathers' scores 
is dm Meridian i dite scale, and 
ев cf or between the standard 
Sres d of the mothers and fathers 
байсан vel: the attitude-toward-inter- 
cally si E scale are also statisti- 
this Hicant. This is to say that, in 

ampling, mothers as а group 


Shoy $ 
ved a more homogeneous attitude 


Student Hostility 
(Like-Dislike) 


Mothers’ approval 
of Russia 


Fothers’ approval 


Student Hostility 
of Russia 


(Rosenzweiq) 


Student Hostility 
(Like- Dislike) 


Mothers’ attitude of 
friendliness in Int'l Rel's 


Student attitude of 


friendliness in Int Rel's сева 


г=.39 


Fathers’ attitude of 
friendliness in Int'l Rel's 


Student Hostility 
| (Rosenzweiq) 


Fic. 2.—Attitude of friendliness in interna- 
tional relations. (Intercorrelations among student 
attitudes of friendliness in international rela- 
tions, parents’ attitudes of friendliness in inter- 
national relations, and student personal feel- 
ings of outwardly-directed hostility.) 
lationships among the major variables. 
In every case, a high score on the meas- 
ures of hostility indicated hostile feel- 
ings, while a high score on the measures 
of attitudes indicated a friendly attitude 
tQward the country, idea, or institution 
ir^glved. A solid line joining two varia- 
bles indicates that the correlation be- 
tween the two variables is significant at 
the .o5 level. A dotted line joining two 
variables indicates that the correlation 
between the two variables is not statisti- 


Fic, 


corre], p Attitude of approval of Russia. (Inter- 


€ among student attitudes of approval 

Ussia, p d attitudes of approval of 

Wardly-di student personal feelings of out- 
Irected hostility.) 


towar : 
More d Russia than their children, а 
inter homogeneous attitude toward 
dis. опа] relations than either their 
"iie, or their husbands, and that 
hom mothers and fathers showed more 
og: . 
thei geneous attitudes toward war than 
iY children, 
1 - 
е Sures 1 through g illustrate the re- 
Thi 
г r was determined by the F test, where 


512 


Mothers’ Int'l friendliness 
("Marshall Plan" items only) 


Student Int'l friendliness 
("Marshall Plan" items опу) 
Student Hostility 

(Rosenzweiq) 


Fic. 2a.—Attitud! 


Student Hostility 
(Like-Dislike) 


Fathers’ Int'l friendliness 
“Marshall Plon" items only) 


e of friendliness in inter- 
national relations: *Marshall Plan" items only. 
Intercorrelations among student attitudes of 
friendliness on “Marshall Plan" items of inter- 
national-relations scale, parents’ attitudes of 
friendliness on these items, and student per- 
sonal feelings of outwardly-directed hostility.) 
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Student Hostility 
(Like-Dislike) 


Mothers’ opproval | 


of war 
/ 


r= 16 r= 16 
е Student approval eng 
Sd of wor 
- 
/ 
Z 
+12 
/ 


Student Hostility 


Fathers’ approval 
(Rosenzweiq) 


of wor 


Fic, 2b.—Attitude of friendliness in 
national relations: “Ideological” only. 
(Intercorrelations among student attitudes of 
friendliness on "Ideological" items of inter- 
national-relations scale, parents’ attitudes of 
friendliness on these items, and student personal 
feelings of outwardly-directed hostility.) 


imter- 


items 


cally significant. In these figures 


and in 
the discussion which follows, when we 


speak of student hostility or of student 
or parent attitude, we are referring to 
scores on the instruments used for mgas- 
uring hostility and attitudes, &- 

The average of the corre] 
dent approval of Russia ys, mothers’ ap- 
proval of Russia ("x -28), and student 
approval of Russia vs. fathers’ approval 
of Russia (y = 18), is „өз. The average 
of the correlations, student approval of 
Russia vs. student hostility score on the 
Like-Dislike test (r = —.05), and student 
approval of Russia vs. Student hostility 
Scores on the Rosenzweig test (r — =.02), 
15 —.03. The difference between these 
two average correlation coefficients is sta. 
tistically significant. 

Because of the possibility 


ations, stu- 


that differ- 


"This was determined by сопу 
to Fisher's z 


4 r erting the r's 
s and using the form 


ula 


1—2, 


f= 


where 


ent items from the international к 
tions scale might have been ine sri 
differently, inspite of the PE ape 
taken agai д this when the scale sube 
сс was thought that it mig" : 
be fruitful to examine separately i nl 
lationships between student and par wed 
attitudes, and student hostility and be й 
dent attitudes, for separate groups Ak 
items from the scale. Accordingly, e 
sroups of items which were Шона " 
represent diflerent ways of looking z 
international relations were scored 56] al 
rately for each of the three кушше, 
groups (students, mothers, and fathe x 
and these 


х correlat 
subscores intercorrela th 


among experimental groups and "Ti 
the measures of student hostility. ЙТ 
results of these analyses are given 
Figures за and 2b. ations 
Figure 2a shows the intercorrelatt be- 
that existed for scores on Items 5 ( : nd 
lieve that the U.S, should send [ood sads 
materials to any country that ce 
them”) plus 7 (“I think that help! 
foreign countries is a waste of mone 
plus 12 (“It is my feeling that we d 
‘ty to help all nations, whether ^ 
anything out of it or not"). It 


Student Hostility 


55 
Mothers’ Int'l friendlies 
(Like-Distike) 


nly) 
("Ideological” items 0 
J^ 


/ 
n 
r:-28 re tO 


/ 


r*39 Student Int'l friendliness #131 


("Ideoloqical" items only) 


1 

| 

ET | 
| i 
r=.03 | 
"s 


5 
> friendlines' 
Fathers wie | 


ali only. 
("Ideological” items 


r*—3I 


Student Hostility 
(Rosenzweiq) 


ions 
wal 
stu 


с1а! 
гсогтс1а 
Fic. 3—Approval of war. (тогегоо 
among student attitudes of approva and 
Parents’ attitudes of approval of war. 4 


ydly-dir 
dent personal feelings of outwardly 
hostility.) 


-v 


n 
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Lc. that these three items, because 
ms | refer to helping other countries, 
м ж маар apes in terms of atti- 

ward the Mar Plan to à 
greater extent than othe 
жы какы, shows the intercorrelations 
87 ken for scores on Items 1 ("In 
sive La о the United States should 
with dines mg t be on friendly terms 
thay Forks : eniin ) plus 11 (I think 
will do E iendly with other countries 
("1 think = good than harm ) plus 14 
бер “ae being friendly with other 
наса een real help in solving inter- 
opinion Pa Маше ) plus 16 ( In my 
ing is Ж tir e people believe in try- 
p. Rea lie пе with other countries”). 
Prens our items were thought to repre- 

abstract ideological point of view 


to а ere; А 
of greater extent than the other items 
the scale. 


ee in Figure за as compared 
tions Бусы шне 2b show that the correla- 
in Wc oe attitudes of friendliness 
are higher ps relations and student hostility 
“Макы. or the "ideological" than for the 
all Plan" items of the international-rela- 
im p and that the correlations between 
the dei students’ attitudes are higher for 
items pls Plan’ than for the “ideological 
signifi it the differences are not statistically 
cant. 


Th T v І 
the 1e means and standard deviations of 
subscores intercorrelated in Figures 


за a 
| and 2b appear in Table 3- 


As А 
"m differences 


the case of the 


between the means of the total scores 
of students and parents on the atti- 
tude-toward-international-relations scale, 
none of the differences between the 
means of the subscores of parents and 
students are statistically significant. The 
differences between the standard devia- 
tions of the subscores of students and 
their mothers are statistically significant 
in the case of scores on the "Marshall 
Plan” items. The differences between the 
standard deviations of the subscores of 
mothers and fathers are statistically sig- 
nificant in the case of scores on both 
the “Marshall Plan” and the “ideologi- 
cal" items. That is to say, mothers, as a 
group, showed more homogeneous at- 
titudes on the "Marshall Plan" items 
of the attitude-toward-international-rela- 
tions scale than their children. and had 
more homogeneous attitudes on both the 
‘Marshall Plan” and "ideological" items 
ofthe international-relations scale than 
the Y husbands. 

Because of the low reliability of the 
attitude-toward-war scale, it was thought 
that, as in the case of the attitude- 
toward-international-relations scale, it 
might be fruitful to examine the rela- 
under investigation separately 
ate groups of items from the 
two groups of items 
o represent differ- 


tionships 
for separ 
scale. Accordingly, 
which were thought t 


ent aspects of attitude toward war were 


TABLE 3 


MEANS AND STANDARD DEVIATION 


TTITUDE 


Subscore 


s OF THE SuBSCORES 


FROM THE SCALE 
ATIONS 


ATIONAL RE 


TOWARD INTER? 


= | Standard 


Stud R 
3 ee scores on “Marshall Plan" items... 
Wheat e CUTS Oft “Marshall Plan" items- 
Де а Ces оп “Marshall Plan" items. 
Е Others’ scores on "ideological" items 
era ое on “ideological” items: -- ~~ 
5' scores on “ideological” item$-::::* М 


Mean Deviation 
petites 10.5 | 2.4 
. 10.5 2.0 
10.2 2.4 
| 16.6 2.1 
| 15.8 1.9 
| 15.9 | 2.2 
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Student Hostility Mothers approval of war 
(Like-Dislike) ideological” items only) 


7 
/ 


/ 
#14 


a 
/ 


Student approval of war 
{Ideological” items only) 
r».23 
Student Hostility 
(Rosenzweig) 


Fic, 84.—Approval of war: "Personal Partici- 
pation" items only. (Intercorrelations among 
student attitudes of approval of war based only 
on “Personal-Participation” items of the atti- 
tude-toward-war scale, parents’ attitudes of ap- 
Proval of war based on these items, and student 
personal feelings of outwardly-directed hostility.) 


reg 


г-39 г=.26 


Fathers’ approval of wor 
"Ideological" items only) 


scored separately for each of the experi- 
mental groups (students, mothers, and 
fathers) and intercorrelated among ex- 
perimental groups and with the meas- 
ures of student hostility. The results of 
these analyses are 
and 3b. Р 

Figure ҙа shows the intercorrelations 
that existed for scores on the items “Тһе 
benefits of war outweigh its attendant 
evils” plus “War in the modern world 
is as needless as it is suicidal” plus 
“There is no Progress without war." It 
was thought that these three items repre- 
Sent an abstract ideologica] attitude 


toward war to a greater extent than the 
other items of the scale, 


Figure 3b shows the intercorrelations 


“If 
y enters a war which he 


ild 


Siven in Figures EI 
Е. 


nevertheless serve at t 


ever he is needed” plus “Tt is our duty 


var” plus “He 
true hero” plus 
he individual to 
any way in any 


war, no matter what the cause.” It was 
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thought that these four items repre- 
Ё i r- 

sented an attitude toward personal par- . 


ticipation or actual behavior in Me o; 
war to а ger extent than the othe 
items of tlf cale. " 

The correlations in Figure ga as pv 
pared to those in Figure 3b show e 
the correlations between student "d 
tudes of approval of war and аш 
hostility are higher for the “ideologica’. 
than for the “personal-participation 
items of the attitude-toward-war sale 
and that the correlations between pee 
ents’ and students’ attitudes are of differ" 
ent signs for the esegue on 
items as compared with the “еск 
items, The differences between the Ош 
lations student-father and father-mothet 
for the “ideological” items of the кү 
scale (Fig. за) and for the КА" 
Participation" items of the war Sca 
(Fig. 3b) are statistically significant. 

The means and standard deviations S 
the subscores intercorrelated in Figure? 
За and 3b appear in Table 4 


А сеп the 
А5 in the case of the differences БЕЙ ents 
means of total scores of students and ра 


wor 
Mothers’ approval rs i 
("Pers. Part" items 


Student Hostility 
(Like-Dislike ) 


/ 
N / 
ra-.il 


oval of Wor 
nly) 


Student Hos tility 


Fathers’ appr 
(Rosenzweig) 
Ten 


("Pers. Port" items 0 


» items 
titudes 


Fic, 3b.—Approval of War: “Ideological 
only. (Intercorrelations among student ologica Й 
ОЁ approval of war based only on “Ide 


aren 
items of the attitude-toward-war scale, Е these 
attitudes or approval of war based OM ү. 
items, 


and student personal feelings 9 
Wardly-directeq hostility.) 


= 
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TABLE 4 


{5 AND STANDARD DEVIATIONS OF THE SUBSCORES FROM THE 


SCALE ox ATTITUDE TowARD WAR 


= < 
E 


Students’ 

ents "s 4 ical' i 

Mothe E on ‘ideological items 

Fathers’ sul scores on “ideological” items 
tbscores on ‘ideological’ items.....-- 


tudents’ 
5 D s P 
Mothers’ gulpscores on "personal-participation" items. 
athers' si 1 scores on. personal-participation" items 
ibscores on “personal-participation” item 


Mean Standard 
Deviation 

5-7 2.4 

6.2. 2.0 

6.1 2.0 

16.6 2.7 

16.2 | o.6 

| 16.8 | 1.8 


on жн 
Sae ade ipd scale, none of the 
Of parents EE the means ot the subscores 
cant. The ШЕ students are statistically signifi- 
Viations of th ‘erences between the standard de- 
children Sui subscores of mothers and their 
Statistical A mothers and their husbands are 
ideore neq ee in the case of both the 
of the atüt en personal-participation" items 
between s e-toward-war scale. The differences 
Scores of es standard deviations of the sub- 
tistically si athers and their children are sta- 
радан pene in the case of the "personal- 
as а grou w items. This is to say, that mothers, 
9n both р, Ез a more homogencous attitude 
Participatio the: ideological” and “personal- 
Scale than п items of the attitude-toward-war 
ands, and аер their children or their hus- 
More hom thar fathers, as a group, had a 
Patticipation” 6048 attitude on the “personal- 
Scale tha ion” items of the attitude-toward-war 
зап their children. 


Effec ч 
lect of Home Conversation about 
International Relations 


але correlations between indices of 
internati 9 home conversation about 
aitte tose relations and scores on the 
1050 pelles eee and lacked 
à urther ; significance. The scores were 
it was md by subgroups, because 
Tevea] Qu e that this procedure might 
Obscureq relationship which was being 
Correlati or minimized by the Pearson 
rate sitet technique. Accordingly, sepa- 
Wo an ations were calculated for the 

Porteq ord groups: parents who re- 
about m аб they talked a great deal 
ternational relations with their 


child; 
dren (N = 48), and parents who re- 


ported that they did not talk at all about 
international relations with their chil- 
dren (N = 39). The results of this 
analysis showed that correlations be- 
tween adolescents’ and parents’ attitudes 
were generally greater in homes where 
parents and children discussed inter- 
national relations than in homes where 
1 not, but the increases in the 


they dic 
not statistically sig- 


correlations were 
nificant. 

order to find whether there were 
ifferences in the kind of attitudes , 
eal of con- 


ak, 
held when there was a great d 
versation about international relations 
in the home as compared to when there 
was none, the mean scores of adolescents, 
mothers, and fathers were calculated 
separately for these two extreme groups. 
The results of this comparison showed 
that the mean scores on the attitude tests 


were the same whether there was no con- 
at deal of conversation 


versation or a gre 
the 


about international relations in 
home. 


Effect of Parental. Gontact with Other 


Gountries 


Indices of amount of parental contact 
with other countries (obtained from 
answers to questions under Section 2 of 
the parent-interview form) were corre- 
lated with all other data, and found to 
be significantly correlated only with 
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students’ vocabulary-test scores (г = .19), 
and home-conversation scores (г = .22). 

Because, as in the case of home con- 
versation about international relations, 
it was thought that there might be a 
relationship between amount of parent 
contact with other countries and stu- 
dents’ and parents’ attitudes which was 
being masked by the Pearson correlation- 
al technique, it was thought advisable to 
compare the mean attitude scores of the 
two extreme groups in this respect. Par- 
ents who received a score of zero in 
“amount of contact with other coun- 
tries” (N= 12) were compared with 
those who received the highest possible 
Score (N = 21). No statistically signifi- 
cant differences were found. Thus, 
neither the comparison of extreme 
groups nor the correlational method of 
analyzing the data revealed any signifi- 
cant relationships between the attitudes 


studied and amount of parental cop'&ct 
with other countries. pe 


Effect of Frequency of Church 
Attendance 
Indices of 


the frequency of ado. 
lescents' 


church attendance (obtained 
from answers to Section 3 of the parent- 
interview form) were correlated with all 
other data, and found to be 


significantly 
correlated with student attitudes toward 
international relations (= =;08); 


Effect of Economic Position of Parents 


Indices of the econon 
the parents used in this 
from answers to q 
5 of the р 
correlated 


lic positions of 
study (obtained 
uestions under Section 
arent-interview form 
with all other 
found to be significantly 
student vocabul 
mothers' 


SB). 


) were 
data, and 
correlated with 
ary scores (r = -28), and 


attitude-toward-war scores 
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Effect of Adolescent Intelligence 


Adolescent vocabulary scores, which 
were taken as- measure of adolescent 
intelligence ztere correlated with all = 
data colles, and found to be signi? 
cantly correlated with adolescents’ au 
tudes toward international л, 
(т = .21), attitudes toward war (r pt er 
mothers’ attitudes toward prune 
relations (r — .20), and index of parent? 
economic position (r = .28). — 

Because it was thought that the — | 
lation between intelligence and а 
lescents’ attitudes toward internationa 
relations and war might be confounding 
the correlations between adolescents ps 
parents’ attitudes on these topics ad 
correlations between adolescents s 
parents' attitudes on these topics poo 
recalculated with vocabulary score pa è 
tialed out, It was found that this p^ 
cedure had a negligible effect оп vas 
adolescent-parent coefficients, and it ү 
therefore concluded that though үр a 
lary score (intelligence) was correla 
With attitudes toward war and wer J- 
international relations, it had no = 
Preciable effect on the relationshil 
under consideration. 


pu- 


IV. DISCUSSION the 
In general, it can be said that геге 
original hypotheses of the study аа 
Supported in the case of some pers 
but not in the case of others. The а 
lations are : 
where 
From t 


all small, even in the vend 
the hypotheses are mp. as 
le results of this study as pu re- 
other studies, it is apparent Шак anc 
lationships that exist between chile atti 
parent attitudes, as well as between ё e 
tudes and personality factors, ee о 
pendent upon many factors. In v all 
this fact, we would expect to finc anc 
small Correlations between attitude 
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any single factor. 
The specific findings of the study will 
adings: influ- 


be discussed under twe 
ence of parents’ attitudes, 
of personal feelings об 
directed hostility. в | 


outwardly- 


Influence of Parents’ Attitudes 


Pin EM results of this study parents 
ln tod ? ac more compartmentalized 
dien. елу than are their chil- 
ене ме ехатіпе the table of 
(Table a ыры for the major variables 
dent йк WS Hoe that the variable, stu- 
Чөп —— friendliness in inter 
respect Em ations, leads all others with 
Gordan: o isa of | enificant mter- 
With ^ hie It is significantly correlated 
study, wl ny principal variables of the 
а a е the other attitudes (student 
түш in WW and ol Russia) are sig- 
Maldita ашышы with only 5 and if 
that ike варите. It seems likely 
adolesente a for this is the fact that 

эчеп» inter- 


йайопа те} attitudes toward 
siderabl relations are derived to d ton 
sions "s extent from parental discus 
tional ral specific aspects of inter 
and к» | relations, for example, Russia 
lonas [е parents’ attitudes toward 
related we relations, however, are до? 
— d the same extent to specific 

s of such relations, such as wat and 


Our rela; : Å 
Our relations with Russia. We find that 


nie AN attitudes toward inter- 
attitude relations are related to parental 
that "id toward war and Russia, but 
War ber: adolescents’ attitudes toward 
ental sae ag are not related 10 par- 
ations пй toward international rë- 
amd able 2). The fact that parents 
eas especially mothers’, are not 
m to the extent that ado- 

І brought out 


quite attitudes are, is 
clearly in Table 1. The lower re- 


liability of the attitude scales for the 
parents as compared to adolescents is a 
further indication that the parents are 
more compartmentalized in their think- 
ing (i.e.. their answers to the items of the 
scales show less item-to-item consistency 
than the answers of their adolescent 
offspring). 

Another generalization that сап be 
drawn from the data of this study is that 
adolescents tend to adopt an attitude 
which is somewhat more extreme ог 
emphatic than the attitude of their par- 
their mothers. The 


ents, especially 
of the attitude 


standard deviations 
scores and subscores of the mothers are 
in every case smaller than those of the 
adolescents: significantly so for all scores 
and subscores except those оп the 
“ideological” items of the international- 


relations scale. The standard deviations 


& the attitude scores and subscores of 
tlsfathers are in every case except scores 
ana^subscores on the attitude-toward- 
international-relations scale (where they 
are approximately equal) smaller than 
those of the adolescents: significantly so 
in the case of total scores on the attitude- 
scale and subscores on the 


toward-war 
items of the 


"personal-participation' 
le. On examining 
ndividual cases, 


attitude-toward-war sca 
the pattern of scores in i 
it appears that the reason for the 
greater variation in adolescent sociopo- 
litical attitudes as compared to those of 
mothers and, to а lesser extent, fathers, 
might be that when adolescents’ atti- 
ose of their parents at 
lways have a more ex- 
treme score than that of their mothers 
(and often that of their fathers too), 


though in the same direction. That is, if 
a mother who has a 


tudes resemble th. 
all, they almost à 


an adolescent has 
mildly friendly attitude toward Russia, 


for example, the adolescent is likely to 
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have a distinctly friendly attitude toward 
Russia, and contrariwise, if the mother 
has a mildly unfavorable attitude toward 
Russia, her adolescent offspring is likely 
to have a distinctly unfriendly attitude 
toward Russia. This “leverage” theory 
offers an explanation of the fact that 
there are no significant differences among 
the mean scores of the adolescents and 
parents, but frequent significant differ- 
ences among the standard deviations of 
their scores. 

The results of the analysis of the 
“ideological” as compared with the 
“personal-participation” items of the 
attitude-toward-war scale (Fig. ga and 
3b) bring to light the interesting fact 
that, for this population, parents and 
children tend to have similar ideological 
attitudes toward war, but tend to have 
dissimilar attitudes toward personal par- 
ticipation in war. In the case of (Ќе 
“ideological” items, adolescents’ g®i- 
tudes and those of their parents are 
positively correlated (significantly so in 
the case of adolescents and fathers, very 
near significance in the case of adoles- 
cents and mothers), but in the case of 
the “personal-participation” items ado- 
lescents’ attitudes and those of their 
parents are negatively correlated (sig- 
nificantly in the case of fathers, non- 
significantly in the case of mothers). 'The 
average of the correlations students vs, 
mothers and students vs. fathers on the 
"ideological" items of the war scale is 
18. The average of the correlations stu- 
dents vs. mothers and students vs, fathers 
on the "personal-participation" items of 
the war scale is —.16. The difference be- 
tween these two average correlation 
coefficients is statistically significant. 

Most of the correlations between 
parents' and students' attitudes and be- 
tween attitudes of husbands and wives 
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which are reported here are lower than. 
those reported in other studies. This a 
be due to djferances in samples studie : 
or it may Б ліце to the fact that pet 
studies has depended upon the child 
subjects to obtain the attitudes of ce 
parents. The sample studied here nae 
from others in that the children поне 
were exclusively adolescents within M 
narrow age group, and it might be sal 
that the low degree of relationship be- 
tween parent and child attitudes 15 М 
result of the adolescent revolt a 
caused subjects to reject the attitudes a 
their parents at this particular stage z 
their development. This does not, ш 
ever, explain why the correlations т 
tween husbands and wives were ee 
than those usually reported, and this wg 
turns us toward the second possible à x 
planation, that previous studies have E 
pended upon the child subjects to pe 
the attitudes of their parents. Since - 
subjects willing to obtain the attitude? 1с 
their parents were included, it is po5?! m 
that in previous studies this may P? It 
had a biasing effect on the resike у 
seems likely that subjects who are gi ts 
to obtain the attitudes of their peu. 
are probably more cooperative in gene ir 
and have better relationships with the h 
parents than those who are not. OH 
children could be expected to ent 
more closely with their parents, ane pm 
would expect that the relationships ir 
tween their attitudes and those of К" 
parents would be higher than those Al 
tween children and parents in anii a 
We would also expect parents to B E 
better-than-average relationship tO nae 
other in cases where they tend to Mich 
à better-than-average relationship meat 
their children. Such parents would vate 
to identify with each other to à Pe D 
extent than in the general popula"! 
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thereby bringi i 

aa х bringing about a higher relation- 
p between their attitudes than in the 

general population. 


Influence of Personal Li üngs of 
Outwardly-Directed F stility 


фы» нра that is posed by the 
er PS study is not whether there 
ead med Lane adolescents 
«ais and D of outwardly directed 
дг» сй and their sociopolitical atti- 
in cad E why it is that relationship ex 
Train — the attitudes studied (in- 
for p and war) but not 
ача ( ussia). In other words, why is 
rm sic em adolescents attitudes 
with, ie раан) significant correlation 
сяст personal feelings of outwardly- 
onde ape. and sometimes do not? 
hysothesls: of this experiment suggest an 
it is im m answer to this question; 
fin deni first, however, to review 
(or is ain we the selected groups of items 

bons es) of the full scales. 
attitude-tz of the low reliability of the 
to lack oward-war scale, probably due 
the ania homogeneity of the scale, 
clear-cut Sere On this scale have no 
уннн and it appears more 
9n the е ж consider only the subscores 
ticipatio. ideological” and personal-par- 
Same gie items of the scale. For the 
to йс it appears more reasonable 
l the “ideological and 
tionakrelati lan” items of the interna- 
Ourselves tions scale. After thus limiting 
Scores; tt are left with five attitude 
the "usns toward Russia, scores pe 
Е shall Plan,” and «ideological 


item 

SO i , н 

апа Е the international-relations scale, 
"ideological an 


laa on the 
nal-participation” items of the at- 


titu, a 
e- 

toward-war scale. These scores may 
ories: 


Sart 
ra " 
nged into two general cates 
h are 


Sco 
res “ É 
which reflect attitudes whic 


H 
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subject to strong social pressures (e.g. 

Russia, “Marshall Plan" items of the in 
ternational-relations scale, and the “per- 
sonal-participation” items of the attitude- 
toward-war scale), and scores which are 
more abstract and less subject to social 
pressures (6.5, the "ideological" items of 
the scales measuring attitude toward in- 
ternational relations and attitude toward 
war). 

If we examine the figures showing the 
correlations between the scores of adoles- 
cents on the above measures and their 
scores on the tests of adolescents’ personal 
feelings of outwardly-directed hostility 
(Fig. 1, 20, 2b, 3a, and 3b), it appears that 
the highest correlations between attitude 
and the measures 
the "ideological" 


of hostility occur for 
items of the interna- 


tional relations and war scales, in regard 
to which there tends to be little social 
pressure. As a matter of fact, with only 
огт, exception there are no significant 
réieonships between any of the more 
specific attitudes toward which there 
tends to be considerable social pressure, 
and the measures of hostility. On the 
other hand, if we examine the correla- 
s between the above scores and par- 
ears that the lowest 
dolescent attitudes 


tion 
ents’ scores, it app 
correlations between a 
and those of their parents are on the 
abstract “ideological” items, toward 


which there tends to be less social pres- 
and the highest correlations be- 
rental scores 


tween adolescent апа pa 
tend to be on the more specific attitudes 
toward which there tends to be consider- 
able social pressure. The hypothesis 
which these results suggest is that when 
pressures with regard to an atti- 
ng—as they are, for example, 
in the сазе of attitudes toward Russia— 
the effect of personality factors is over- 
ruled; and, conversely, when social pres- 


sure; 


social 
tude ате 5170 
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sures with regard to an attitude are not 
strong, the attitude held is more likely 
to be consistent with the person's char- 
acteristic ways of reacting. This hypoth- 
esis offers an explanation for many atti- 
tudinal phenomena the explanation for 
which is at present not very satisfactory. 
It offers an explanation, for example, of 
why many Southern whites who do not 
seem to be displacing personal feclings 
of hostility nevertheless have strongly 
hostile attitudes toward Negroes: it may 
be because of the social pressure from 
their own group, which would ostracize 
them if they professed any' but the 
(Southern) socially approved attitude. 
The instruments used in this experi- 
ment were not designed to test the above 
hypothesis, and it seems likely that the 
exceptions to it that were found may be 
due to this fact. None of the so-called 
“Marshall Plan” items actually mentien 
the Marshall Plan, and it seems у 
that these items were interpreted ^, а 
general abstract Way as well as in terms 
of the specific "Marshall Plan.” This 
may be why there was а statistically 
significant correlation between adoles- 
cents' scores on these items and their 
scores on the Rosenzweig test. Similarly, 
the "ideological" items are not strictly 
"ideological" and free from social 
sures, as we would like in order 
the hypothesis; and this 
there is a statistically signi 
tion. between adolescents’ 
scores on the “ideological” 
attitude-toward-war-scale, Ir 
the fact that our instr 
signed to test the 


pres- 
to test 
may be why 
ficant correla- 
and fathers! 
items of the 
1 addition to 
uments were not de- 
above hypothesis, we 
have of necessity concerned ourselves 
with only a fragment of the social and 
personality forces acting on the individ- 
ual! To test the hypothesis adequately 
would take a different and more elabor- 
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; А » which 
ate study than this one, but one whicl 


i i - Ynowl 
might add considerably to our Know ; 
а 1 а, E a 
edge of the wav attitudes are formed А 
| er. МҮ M Tt Р 
elunction іле life of the individual. 
ins 


% 


"V SUMMARY 


The present study began with k^ 
belief that sociopolitical attitudes are t "i 
result of a complex interweaving of pet 
sonality and social factors, but that prob- 
ably, in most cases, social [actors are the 
more important of the two. An cape 
ment was conducted to test this belief a 
investigating the relationship ш 
sociopolitical attitudes of 166 adolescen i- 
(high-school seniors), sociopolitical t 
tudes of their parents (165 mothers i 
165 fathers), and some measures of а 
lescent hostility, «vasti 
The sociopolitical attitudes енәр 
gated were (@) attitudes toward gerd 
(b) attitudes toward international tiie 
tions, and (c) attitudes toward ME : c 
scales on attitude toward Russia E 
attitude. toward international seti 
were constructed by the experimen” 
using the Likert technique; the scale 16- 
attitude toward war consisted of а 
item Likert version of Droba's scale. 10 
The measures of hostility Cona esr 
the extrapunitive scores of the a 
" " : icturc-F ru? 
cents on the Rosenzweig Picturc-I a 


g this 
ГА 


Was stated in Section I, in Кр ОЛ 
Ап attempt was made to select 

which seemed most important in dele phere 
the sociopolitical attitudes of adolescent ер of 
is a question, however, as to whether опис 
the “most potent" factors affecting дыш a 
attitudes of adolescents which have ps side 
lected are equall most potent.” on ie 
ОГ social forces, it seems likely that М 
What is probably (he “most potent 
(parents! attitudes). In. the personality mew 
howey Т, we may have what is only ae 
Potent” rather than “most potent. 
Measurement of 


study 


we 


"TEC 
ght 
personality factors oti 

to higher correlations with this aspe 


|: 
AK MÀ HR a ĖŘ 
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E and their scores on a Like- 
is z T [ 1 i i 
slike scale of a semiprojective type, 
adapted by the experi 
scale used for the measuremé 
sive impulses by the Progré.| 
tion Association i r i Е 
АА n Association in the evfluation of the 
ight Year Study. 
\ — эн r ^ э = * 
Measures of adolescents’ intelligence, 


ater from a 
of aggres- 
ге Educa- 


Geen. : conversation about interna- 
tend - ations that went on in their 
oier м ы of parental contact with 
тр Р el of church at 
tion sere ol l petibus economic posi- 
ка obtained. 
a scales and personality 
win = ien to the adolescents during 
кәя ем "€ classes in American history, 
кышу. attitudes were obtained by 
bcne d the attitude scales to the 
ing = uring the course of interview- 
Were " be: their homes. Al variables 
Scones ene in terms of numerical 
ёз and intercorrelated. 
wee conclusions of the study 
Cor at for the population studied: 
йт between adolescents’ ас 
smaller E thosc of their parents are 
studies [o those indicated by previous 
adolesce revious studies have relied on 
titudes а themselves to obtain the at 
a есу their parents, thus introducing 
Sulted ng tont which may have re- 
Thee Speci high coctelations. 7 
cant ыл but statistically signifi 
and ias RUNS between adolescents 
аа way m attitudes toward Russia 
tively); p re .28 and re ae сере 
attitudes ы een adolescents and е 
foward е Russia (r = -18) ай 
tween hel relations (r 25 ир 
Mess in Bae село attitudes of h sed 
Measures ee relations and bot h 
P Б adolescent hostility (average 
tudes or and between adolescents’ аш- 
approval of war and hostility 


scores on the Like-Dislike Scale (r = .16). 

Parents’ attitudes (especially mothers’) 
appear to be more compartmentalized 
than those of their adolescent offspring. 
The adolescents’ attitudes studied were 
all significantly intercorrelated. The at- 
titudes of fathers were significantly inter- 
correlated only in the case of attitudes 
toward. Russia vs. attitudes toward inter- 
national relations, and in the case of 
attitudes. toward Russia vs. attitudes 
toward war. The attitudes of mothers 
were significantly intercorrelated only in 
the case of attitudes toward Pusda VS. 
attitude toward international relations. 

The influence of mothers’ and (to a 
lesser extent) fathers’ attitudes on those 
of their adolescent offspring tends to 
take the form of the adolescents adopt- 
ing an attitude which is somewhat more 
extreme or emphatic than the attitude 
of their parents. 

_Selescents’ attitudes toward Russia 
are significantly more closely related to 
their parents’ attitudes toward Russia 
than to their personal feelings of out- 
wardly-directed hostility. 

An analysis of subscores on groups 
of items from the scales on attitude to- 
ward international relations and attitude 
ar suggest the hypothesis that 
when social pressures with regard to an 
attitude are strong, the effect of personal- 
ity factors is overruled; and, conversely, 
when social pressures with regard to an 
attitude are not strong, the attitude held 
is more likely to be consistent with the 
person's characteristic ways of reacting. 
Neither amount of conversation in the 
home about international relations nor 
amount of parental contact with other 
countries has a significant effect on the 
adolescents' attitudes studied nor the 
degree of relationship between adoles- 
and parents attitudes. 


toward м 


cents’ 
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There were no Statistically significant 
differences among mean attitude scores 
of adolescents and their parents, but the 


standard deviations of the scores show | 


mothers as a group to have significantly 
more homogeneous attitudes than ado- 
lescents as a group. 

Intelligence, as measured by the 


Thorndike 20-word vocabulary test is 
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significantly correlated with attitudes 
toward international relations and wat; 
but was fo. ©? zo have а negligible effect 
on the rel; nships under investigation. 

For айб сепа, frequent church at 
tendance is reliably associated with less 
liberal attitudes toward international 
relations. 
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"e INTERVIEW FORM: 


Name .... 
ee oe ae ТШДЩ -— 
V Bath AN REIR Fem SEE LABS ааа абва “АЙ. NOs ceca e snes ad ENS 
m a EE СҮТТҮҮ КЫ o 
iw talk about international relations here at home? ES 
—— ——) never (2) ( ) rarel i 
А 2 arely (8) ( sometimes 
(4) (-— —) often 
Amount of talk about international relations ...... 


s poss ever lived abroad? ( ) yes (2) 
herein pepo Who have lived abroad? (. ) yes (1) 
Shen i = foreign languages? (. ) yes (2) 
"ец € who speak any foreign language? ( 

a riends who come from other countries? (. 


) yes (1) 
) yes (1) 


Index of contact with other countries ...... 


* Does your 
your son or daughter attend church? 


) rarely (3) ( ) sometimes 


(1) (— ——) never (2) ( 

(4) (——_) often 

ОТИУИ . Index of frequency of church attendance ...... 
you think of the questionnaires you have just taken? 


5. Esti 
Stimated cost of house: 


(1) under $10,000 
—— (2) $10,000 to 15,000. 
(8) $15,000 to 20,000 
(4) $20,000 to 25,000 
(5) over $25,000 
(rate on a 5 point scale, (1) very cheap, (3) average, 


A 


uat cost of furnishings 
a ту expensive) 

n i Miis а саг? (___) yes (1) 
Vsus ave a telephone? (. ) yes (1) 
0) 15 your profession (husband)? 
Жс ашапга worker, includ 

gi Semi-skilled worker. 
—~ Proprietor of small business (value less $5000). 


ing laborer or domestic servant. 


"-— Skilled worker. 

enm Clerk or kindred worker. 

CEN Semi-professional or smaller offici 
—— Professional or proprietor of large business ( 


al of large business. 
value more than ($5000). 


Index of economic position ...... 


Hie icis Scoring of the Parent Interview Form 

an айаны of the parent interview form consisted of simply adding up the weights assigned to 

чапца ауе answer to each question under each of the four sections of the form for which 

t ë ЁК indices were derived (Sections 1, 2, $ and 5). The answers to Section 4 (parent reactions 

ee ude scales) were written in by the interviewers and later categorized and tabulated by 
menter, The tabulation of parental repli in Appendix B. 


ons used in this form i 
ss in America: A manual of pro 


es to this question appears 


s adapted from that of Warner, W. L. 
cedure for the measurement of 


е: 


1 
he 
Meeke м. Sorization of professi 
cial s Мэ & Eells, К. Social cla 
5. Chicago: Science Research Associates, 1947- 
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APPENDIX B 


ADOLESCENT AND PARENT REACTIONS 
TO THE ATTITUDE SCA 


Parent reactions to the attitude scales were categorized and t 
results of this tabulation appear in Table 5. 

As сап be seen from Table 5, most of t 
unfavorable. h 

On the basis of observation while interv; 
it is the opinion of the experimenter that 
tudes toward the scales was that many of th 
represented a “test” to them, Although they were assured that the si 
opinions, and had no relation to their intelli: 
they had never come in contact with scales of 


acpi ires were 
he comments of the parents about the questionnaire: 


this sort before, and felt that they were some 

are overlapping and солга si 
This "threat" aspect 9 afi 
and open expressions of opinion might have А 
ith the interviewers, who could then have rated de 
ould introduce new errors in the subjective ймы, 
If a careful semi-controlled intery iew scheme were worked out 


i к t ant of 
у у that this method might yield somewhat more accurate measurement 
attitudes than the use of attitude sca of the type used in this study- 


les with adult subjects 
The adolescents were generally enthusiastic about the study and their part in it. In answe t 
Item 95 of the Likes and Dislikes questionnaire, "Answering questionnaires like this," 68 per d 
of the adolescents responded by circling the “Like” or “Strongly Like” symbols, 17 per cent circled 
the question mark, and only 15 per cent circled the “Dislike” or Strongly Dislike” gyno 
Adolescents’ attitudes toward th z 


n ә „ on 
е t ‹ 1e questionnaire were given а numerical index of from 1 t0 5 
the basis of their replies to Question 95 of the Likes and 


ейн indices were 

E ‹ Д Dislikes scale, and these indices 

correlated with all other variables. No significant correlations were found 
| А 


r to 


TABLE $ 


> (T Re 
PARENT REACTIONS to THE ATTITUDE 


ScALEs 
Number of 
Comment of Times 
ommented 
Upon 
Hard to answer because need to 

qualify 41 
16 
14 
II 
ommunistic. . Е 
rawn out... xi : 
Lar propaganda.. |” Sas esce] i 
ows type of citizen m WE i 
Presumptuous залаа i 
oyalty test. : 
ed PR : 
atisfactor О.К 6 
Good..... ru J Е 
Thorough. . |” 
No comment, . 777 А 
SP Ru euet os 29 
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INTRODUCTION 


During 1945, at the height of World 
War п, there came to the U. $. Naval 
Hospital at San Leandro, California, a 
arge number of patients about whom 
үче was question of diagnosis of "epi- 
“psy.” At the suggestion of the medical 
os in command of the hospital, Dr. 
V. F. Kennedy, an intensive study of 
these patients was made. 

Three broad lines of investigation 
Were established. First, each patient was 
Biven the usual medical examination. 
The neurological examination was par- 
ticularly thorough; prominent among 
the Special techniques used was the water 

ltressin test. A second examination was 
electroencephalographic (hereafter re- 
ferred to as the EEG); under resting 
conditions and following hyperventila- 
tion the electrical activity of the brain 
was measured; records were judged 

abnormal,” “borderline,” and “пог- 


п this research the author has utilized the 
Wish €s Of several persons whose kindness he 
hc. 10 acknowledge. Basic test data were 
author 4 in the hospital atmosphere by the 
d т and three colleagues to whom he is in- 
red. especially: Barbara Н. Krieger, Suzanne 

` ау, and Dr. G. T. Lodge. » é 

е сове ОЁ their participation in the analysis 
Pecial sorts of data, the author wishes here 

Jan Paul Greenberg, Winifred Ingram, and 
i aulsen. He wishes to acknowledge a debt 
Particular to Natalie Kettleman, whose dis- 


Serta; 
data, Чоп (10) was concerned with the Rorschach 


of 
to 


mal.” (A report of these medical findings 
has been published previously (9). The 
third type of examination was psycho- 
logical, consisting of several procedures. 
Two questionnaires filled out by the 
patient were checked in interview with 
him. The psychological instruments 
which were applied include: 


a. The Cornell Selectee Index (CSI. This 
scale, designed for screening at induction and 
recmuiting stations, consists of 64 items con- 
cerned for the most part with subjective physi- 
cal ppplains. 

b. Zl history blank, covering briefly items 
regarding parents, schooling, jobs, arrests, health, 
accidents, and military experience. 

c. The Minnesota Multiphasic Personality 
Inventory (MMPI) (8). (The standard procedure 
used for the scale was modified slightly by 
eliminating from the total of 550 items the 
250 which do not contribute toward a score.) 
This inventory asks that the subject decide 
about each of a number of statements whether 
it is "True" of himself or "False," and it al- 
lows him to express uncertainty or indecision 
by classifying the item "Don't know" or "?". 
Main variables of the MMPI in its original 
standardization were determined empirically on 
the basis of differences between "normals" and 
groups classified according to neuropsychiatric 
diagnosis. Thus, a scale designated as Hy is 
composed of items which distinguish between 
controls and a group of hysteric patients. Of 
these main variables, there are the following: 
Hs (hypochondriacal patients; D (depressive 
patients); Hy (hysteric patients); Pd (psycho- 
pathic deviate patients); Pa (paranoid patients); 
Sc (schizophrenic patients; and Ma (manic pa- 
tients. Also, there is a scale, Mf (scored for 
interests similar to those of the sex opposite to 
oneself). 

It is arranged that the raw scores for each 
of the variables of the MMPI may (by trans- 


ro 


mutation into 2 scores, where the mean equals 
50 and one sigma equals 10 points) be plotted 
оп a chart. Any patient may be compared easily 
with the norms by means of this chart. 

d. Parts of the Wechsler-Bellevue Intelligence 
Scale (W-B) (21). This included for most pa- 
tients five tests of the Verbal Scale (Informa- 
tion, Comprehension, Arithmetic, Digits, and 
Similarities) and the Block Designs Test of 
the Performance Scale. 


e. The Rorschach ink blot test, administered 
and scored according to the method of Klopfer 
(11). 

f. The Thematic Apperception Test (TAT). 
This was used in a brief form involving ten 
pictures of the revised series of Morgan and 
Murray (13): No. 3BM, 4, 6BM, 7BM, gBM, 
12M, 13MF, 14, 17 BM, and 18BM, 

Supplementary to this routine battery 
of psychological tests, several other tests 
(the Healy Pictorial Completion II and 
the Shipley-Hartford Retreat Scale) were 
used selectively in individual cases, 

The present report concerns the per- 
formance of the convulsive patient on 
the psychological tests, and the implita- 
tions of the findings for the theory. of 
personality in general and of the pérson- 
ality of the convulsive patient in par- 
ticular. 

It will be found that 


this report is 
organized about 


а conceptual scheme 
which emphasizes Capacity, Control, and 
Motivation. The concepts of these three 
general areas of behavior have been 
found useful in accounting for personal- 
ity and its organization ( 
of Capacity is inte 
aspects of the personality involved in pro- 
ductivity and potentiality anq any dis. 
crepancy between the two. 


ality which the 
1 through his 
would involve 
n other frame. 
or it has to do, 
concerned, with 
gainst anxiety or 
ategory, Motivation, 


work as ego psychology, f 
so far as emotionality is 
methods of defense a 
threat. The third с 
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refers to basic impulses—needs and 
threats which initiate the individual to 
adjust —to capacity and 
control. 
The gróXb studied. The material pre 
sented here was obtained between age 
ary and August, 1945, from a group 9 
72 теп іп naval service. They ranged in 
age from 17 to 49 years, with a median 
of 23.4 years, Length of service (in x 
Navy or Marine Corps) varied from ; 
months to 5 years, with a median ө 
2.2 years. Three patients had шше 
college; 24 (one-third) were high-schoo 
graduates, Only 11 men had less шай 
full grade-school education. All but 2 
men had been overseas, and more than 
one-half (54 per cent) had been in s 
bat, almost exclusively in the Pac! x 
area, as Marines (ground troops), ОГ = 
sailors aboard ship. About one-half © 
the men (47 per cent) had been К 
at least once. In 5 cases (7 per cen 
there was instance of either definite 
Separation or divorce, The fact that 
these men had a record of active ~~ 
over a considerable period of Pune je 
important, since most studies of moe 
leptic" patients utilize hospitalized cas 
of long standing. your 
In response to the question, Was rath 
family broken up by divorce or ^. pa- 
of parents before you were 16?, ш 
tients answered in the affirmative. 
represents 29 per cent of the group: or 
these оү cases, 5 reported по 
Separation; 7 indicated death of o 
mother; and g death of the father. g 
these instances, the father had 
killed, dic 
Neurophysiological findings. Me ving 
findings established the wan 
Points (д): (а) A history of seizures jen 
10 enlistment was elicited in 47 per first 
of the total group. The age of pages 
seizure ranged from infancy to 42 Y 


> onstrate 


his 


al 


| 
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(b) While 59 per cent of the group gave 
à history of head trauma of varying de- 
grees of severity, the ne z7alosist felt that 

no individual in this serie 
which suggested very strong,“ relation- 
ship to head trauma” (9, p- 2). 

EEG study of the total group of 72 
pauents revealed tracings which to the 
encephalographer were "abnormal" in 
33 cases (46 per cent), "borderline" in 
19 (26 per cent), and "normal" in 21 (29 
per cent). In summary, he may be quoted 
as follows: 


There was nothing consistent in the char- 
acter of the abnormal EEG's. Most of them 
contained slow cycles of varying frequencies 
and about one-fourth had organized rapid 
cycles (frequencies between 18 to go cycles 
рег second), usually with slow activity. In 
Only 1 of the 7g! cases was a typical spike 
and wave pattern obtained. Yet several of 
the patients had petit mal attacks, although 
all but three had grand mal seizures also 


(9. p. 3). 

Relevant previous research. The re- 
port of Lisansky (12) in 1948 summarizes 
the research studies of the personality 
of convulsive patients. Test findings ob- 
tained by means of the Rorschach test 
by Rorschach (18), Guirdham (5), Stauder 
(19), Harrower-Erickson (7), and Arluck 
(1) fail in general to support the concept 
of an “epileptic personality.” Lisansky's 
Own research, which compared ten epi- 
leptics and ten diabetics matched 
roughly for age, educational achieve- 


її 1 " 
, Ment, age of onset, and duration of ill- 


ws Suggested that the epileptics had 
Ower W.B performance IQ (99.5 com- 
ne 105.7 for the diabetics). With 
lon ESAE. their response time was 
hoe and they demonstrated more of 
PM a signs" of Klopfer, “more 
sit d Strain and less acceptance of 

an does the diabetic group .. - - 


UTR 
tota] 
give: 


e electroencephalographer included in his 
n Вопр one case additional to the group 
Psychological tests. 


On the whole, however, the groups show 
far more similarity than differences” (12, 
p. 37). Lisansky comments on the lack 
of studies of noninstitutionalized, non- 
deteriorated adult patients using pro- 
jective personality test. 


INTELLECTUAL CAPACITY OF 

THE CONVULSIVE PATIENT 

It was pointed out that only 11 pa- 
tients, or 15 per cent, had less than 
complete grade-school education. One- 
third had finished high school, and 5 men 
(4 per cent) were college graduates. This 
leaves a group of 53 per cent who had 
some high-school education, but did not 
graduate. A number of these men left 
school to enter the service. On the 
grounds of schooling alone, then, it is 
clear that we are dealing with a group 
which is of at least average intellectual 
competence. 

Discussion of the results of perfor- 
mare on tests of mental ability will be 
confined for the most part to the 
Wechsler-Bellevue Scale (hereafter re- 
ferred to as W-B), and more specifically, 
to six of the ten subtests of this Scale. 
These are the five verbal tests (Informa- 
tion, Comprehension, Digit Span, Arith- 
metic, and Similarities) and a single per- 
formance subtest, Block Designs. Fur- 
thermore, since the performance of only 
59 of the total group of patients was suffi- 
ciently beyond suspicion to qualify it 
for research evaluation, this discussion 
will be limited to the results obtained 
with a portion (82 per cent) of the total 
group. 

Intelligence quotients for the full 
scale (five verbal tests and block de- 
signs) ranged from 57 to 132, with a 
mean of 98.3, a standard deviation of 
17.0. The mean is close to that for the 
general population, but variability for 
the convulsive group is greater, although 
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the difference is not significant statisti- 
cally. 

The pattern of performance. An an- 
alysis of the group results with subtests 
of the W-B indicates slight superiority 
of the performance (in this instance the 
Block Design test) over the verbal tests. 
However, the difference is not significant 
Statistically. Examining this trend in 
Somewhat greater detail, reference may 
be made to Figure 1. This represents for 
each subtest, in terms of weighted scores 
(whereby the normative mean isat 10 and 
sigma is set at 3 points, the central 
tendency and variation within one sigma 
for the standardization data furnished 
by Wechsler (21) on adults of compar- 
able age, and for the &roup of convul- 
Sive patients. 

It is seen that the сопу 


ulsives differ 
from the controls most in 


their poorer 
^ 


1. Comparison of Convulsive Group (Shaded 


performance with Arithmetic and with 
Digits; these are differences significant 
at the .01 vof confidence or better. 
The differ; (ce for Information (with the 
convulsivesSagain being less apt) is at 
the .05 level. Differences for the armed 
ing subtests—Comprehension, Similari- 
ties, and Block Designs—are negligible. 
Three patients achieved IQ scores below 
70—namely, 57, 62, and 62. History : 
each case, together with supplementa 
testing, seemed to reinforce the impress- 
lon of borderline mental deficiency. In 
two cases the EEG was considered “nor 
mal," in the third, "borderline." — 
The concept of “deterioration.” — 
the literature on epileptics or cpm 
phenomena there is considerable tenar 
ency to regard such behavior as ec 
of "organic" defect or impairment. bis 
this idea in mind, there was calculatec 


-1 fix | 
> -12 
d 
о 
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3 
г 
ir 
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Mili с Digit sim, Block 

м W-B Subtests 


dults 
) with Wechsler’ ization Group of ^ 
Ope 2 €r's Standardization 

(Open), after Transmutation from Raw to Weighted Scores. 
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for each of the convulsive patients an 
index of "loss" according to the proced- 
ure proposed by Weclisre-.. Зесацѕе, in 
this study, only certain of Wechsler 
Subtests were used, the fol wing form- 
ula was adopted for use with equivalent 
Scores on the subtests: 


to be clear that the “loss” patients are 
no more inclined toward pathological 
EEG records than convulsive patients in 
general, who show, to be sure, a rela- 
tively high frequency of “abnormal” 
EEG records. 

Discussion. Performance with tasks 


(X Information + Comprehension X 2) — (X Arith, Digits, Simil, Block Des х 5 


2 


(X Information + Comprehension x 3 


As this index is proposed, the greater 
the per cent "loss," the greater is the 
patient presumed to be deficient in those 
abilities (as measured by Arithmetic, 
Digits, Block Designs, etc.) which de- 
crease normally with advancing age, and 
With "organic" deterioration. It is sug- 
Bested by Wechsler that when the per- 
centage of “loss” is 20 per cent or more, 

organic" impairment may be suspected. 

Thirty-seven per cent of the convulsive 
Patients show no loss; 46 per cent show 
loss Within the 1 to 20 per cent range 
Which Wechsler regards as inconclusive 
engs of “organic” pathology. The 
remaining 17 per cent of the patients 
demonstrated loss of 20 per cent or more 
—indices ranging from 22 per cent to 38 
Per cent, 
па ранен of EEG evaluations for 
total Oss” group of 10 cases and for the 

group of 72 cases shows little differ- 
ence between the groups. 


Per Cent 
E ocn EEG Total Group Loss Group 
Abnormal 47 40 
Borderline 24 20 
Normal 2 40 


Мыш no effort toward determination 
- the statistical significance of the dif- 
ences between these groups, it seems 


involved in mental tests, chiefly those of 
the W-B Scale, indicates that the group · 
of convulsive patients we are studying 
here does not differ greatly, so far as total 
IQ is concerned, from the “normal” 
standardization group. Their perform- 
ance in certain tasks (mainly Arithmetic 
and Digits) is significantly less compe- 
teħt compared with their performance 
otherwise and with the performance of 
the “Control” (standardization) group. 
On the basis of his studies of various 
types of patients at the Menninger 
Clinic, Rapaport (16) found that pa- 
tients, whatever their psychopathology, 
are likely to show in their performance 
with the W-B verbal tests a deficiency in 
Arithmetic and Digits particularly. To 
him, Arithmetic and Digits are “more 
vulnerable to maladjustment” (16, p. 
166) He feels that within the W-B 
battery of subtests these two tests (in 
which our convulsives are deficient) are 
unique in this respect: they have to do 
with the subject's relation to reality. 
The Digit test, he believes, is a test of 
attention, by which he means "an effort- 
less, passive, unhampered contact with 
outside reality—a free receptivity” (16, 
р. 168). Thus the subject who, like many 
of our convulsives, is low on Digit Span 
is incapable of this easy, spontaneous 
relationship to the reality of his environ- 
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ment. In further discussion Rapaport 
maintains that the ability to attend is in 
inverse proportion to the presence of 
anxiety. 

Like the Digit test, Arithmetic also 
measures the patient’s contact with 
reality, according to Rapaport, but “in 
contrast to attention (measured by the 
Digit Span test) concentration (which 
is measured by Arithmetic) may be 
characterized as an active relationship to 
reality” (16, Р. 168). “Attention then 
may be regarded as automatic, concen- 
tration as voluntary? effort” (16, p. 169). 

If Rapaport’s interpretation of the 
Psychological significance of W-B sub- 
tests is valid, we might conclude that 
the relationship to reality of these con- 
vulsive patients is poor. It seems likely 
that anxiety prevents these patients from 
giving attention—it reduces their тесер- 
tivity, and this, in turn, reduces their 
efficiency in handling problems іт -Цес. 
tually. They possess the Capacity for 
more effective function than they demon- 
Strate, and this is because their private 
Worries reduce stimulation from the 
outside, and hence the facility to mobi- 
lize abilities for optimal performance, 


CONTROL IN THE 
CONVULSIVE PATIENT 


PERSONALITY STRUCTURE As REVEALED 
IN TEST PERFORMANCE 


In this phase of the report comp 
will be made With data obtaine 
“normals” to reveal the 
the convulsive patients 


arison 
d from 
extent to which 
as à group seem 

* Rapaport adds that “ 
in using the expression 


not to] an independent psy: 
as in the past has been 


to utilize particular kinds of adjust- 
ment. Here we shall depend largely E 
data obtai, Dy means of the MM 
and the R fichach test. тй 
In Figuié 2, mcan scores ior na 
MMPI are plotted on a chart eee 
compare any group (or patient) Wit a f 
Scores obtained for control sales О 
either sex. In this instance the ND E 
patients are compared with 293 pms 
for Pa and Pt; 117 for Mf; 294 for id 
D, Sc, and Ma; and 345 for Hy. е 
designations are explained оп P Ph 
Variability of the patient group is pd 
cated by horizontal lines drawn at р е 
and minus опе standard deviation fro 
the mean. А 
Figure 9 shows that the чке 
patients demonstrate greater variabi of 
in almost all of the main “a R 
the MMPI; this is most true of D, he 
Sc, and Hy. Statistical comparison at 3 5 
convulsive group with the control PS 
Shows (at the .o1 level of gu 
increased scores for the former in D, el) 
Hy, Hs, Pt, and Sc; and (at the .05 a 
in Pd. Differences for Pa and Ma are ! 
significant, n 
The results indicate that, when ap 
Pared with the group of controls (a) 
which the MMPI was standardized, sh 
on all main variables, the сойуш 
patients as 4 group have mean nm 
greater than the controls; (b) дее, 
of the convulsive group is least for pie 
ables Pd, Pa, $c, and Ma—varia T 
related in general to psychotic aay d 
it is greatest for D, Mf, Hy, Hs, and “otic 
variables related in general to ie 
nosology; (с) apparent exceptions to thic 
8eneral conclusion are Pd (psychopa n" 
deviate), D (related. presumably ^ in 
Pression), and Mf (tendency to rea 
Ways similar to the opposite sex). con- 
It is our feeling that much of the € 
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PROFILE CHART 
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Fic, o © 
2. Comparison of Convulsive Patients 


the Male Standardization Group, 
е 


ae ша D scale of the MMPI reflects 
honps à ot a mild, nonsuicidal, and 
en aotic nature, and is therefore 
а cues И}, s aeia d 
With О react feminine-wise m consistent 
toos, neurotic (extratensive) adjust- 
sive) o ather than a psychotic (introver- 
in чад (1 his will be discussed further 
MMPI ection with item analysis of the 
is in Seng Ше same reasoning 
Sents a ved regarding Pd; this repre- 
ogy ted masculine sort of psychopathol- 
the sa SS extreme than Pa and Sc but in 
and Pe direction (away from neurosis, 
tween мата psychosis). Differences be- 
Broups M for the standardization 
give je nai that normal control females 
than = her D scores and lower Pd scores 
out — males, a point which bears 
suggestion above. 

hese results show that in the MMPI 
in м the convulsive patients behave 

anner less like that of the control 


Situ 


2 L F H, D Hy Pa 
(Mean Represented by Dot, +1 o by Horizontals) with 


M, Pa Р Se Ma 


in Terms of t Scores. 


men han of the control women. In fact, 
the ñean scores for the convulsive pa- 
tients (with the exception of Mf) are 
very close on all MMPI variables to the 
mean scores for normal control women. 

A general conclusion from these data 
regarding scores for the main vari- 
ables of the MMPI is that the con- 
vulsives tend toward psychopathology, 
particularly of an extratensive, feminine, 
and neurotic sort. Indeed, the profile 
for the group of convulsive men is much 
more like that of normal women than 
that of normal men, if we exclude the 
measure of Mf, or masculinity-femininity 
itself. However, the convulsives demon- 
strate greater variability than the stan- 
dardization group. The fact that they 
are less homogeneous than the control 
group argues against the concept of an 
“epileptic personality” type. 

Data provided by the Rorschach per- 
formance provide an interesting check 


8 Ts W: 


on these results of the MMPI. It is well 
known that, of the several scores made 
of Rorschach responses, those for de- 
terminants are presumed to yield a 
measure of introversive vs. extratensive 
tendency, of ego function and therefore 
of control. j 

In Figure 3 is shown the proportion 
of total responses which is determined 
by each of several possibilities, such as 
movement, color, pure form, etc., for the 
convulsive group (black columns) as 
compared with responses (in blocked out 
columns) for the group studied by Neff 
and Lidz (14) of 38 men in the middle 
10 range. These were soldiers in the 
Pacific area. 

It is seen that the control group excels 
the convulsive group in M (human move- 
ment) and FM (animal movement). The 
convulsive group excels the experimental 
group in m (inanimate movement), її k 
(third-dimensional responses), in F {pure 
form), in С” (black-or-white as color у? апа 
іп FC (form-color). For determinants 


57 


Percentage of Responses 
(To be filled in by Examiner) 
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such as FK (vista), Fc (form-texture), and 
CF (color-form), the groups are еч 
productivezThe;-onvulsives show a Me 
increase i K (difusion) and a decrea 
inc (риге ог). : 
According to Rorschach theory, these 
findings suggest that the convulsive рї 
tients are less spontaneous and impulsive 
—more restrained—than the controls. 
Both groups dehumanize mae 
The controls do this by using диш 
movement (FM); the convulsives do re 
by utilizing movement presumably 
beyond human control, that is, мар. 
mate movement (m). The higher j 
column for the convulsives wp 
greater tendency to sheer repression. 1 s 
manner of dealing with impulses e 
within shifts from spontaneity (M t 
FM) to m and to А, a tendency lor d 
convulsive patients to intellectualize a? г 
depersonalize. As far as social SPOT 
taneity is concerned, the shift from ae 
(notably С and FC) to shading or к 
matic color (C^) suggests that depress! 


Fic. 3. Comparison of Convulsive Ра 


Bright Color 
matic Color 


atients (Black Colur 


Neff and Lid: 
mn) with jects of Ne 
(Open Column) on Rorschac дане поп is s 


h Determinants, 
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and traumatic experience are important 
in the history of these patients. 

In terms of total | ~L-<tivity, the 
convulsive group gave a itp of 10.3 
responses, in contrast to a man of 14.2 
for the controls. This reflected in great 
measure a tendency for the convulsives 
to see nothing, or to reject certain cards. 
The average number of cards rejected by 
the convulsive patients was almost two. 
In order, the most frequently rejected 
cards, together with the per cent of 
rejections, were: VII, 32.0; IX, 29.2; VL 
26.4; X, 90.8; III, 19.4; IV, 18.1; П, 16.7; 
УШ, 12.5; V, 5.6; and I, 1.4. 

It is generally recognized that of all 
Rorschach cards, IX is the most fre- 
quently rejected. ОЁ considerable interest 
is the fact that, among the convulsive 
patients, Card VII (presumed by many 
to be the “mother figure”) was rejected 
More frequently than IX, and that it 
Was rejected much more frequently than 
was IV (the “father figure”). Also of 
interest is the fact that VI (the “sex” 
figure) was third in order of rejection. 
These possibilities are considered in 
greater detail in the following discussion 
ОЁ motivation. | 


MOTIVATION IN THE 
CONVULSIVE PATIENT 


Tur Concert oF SELF 


е patient's present situation. It 
Here be obvious that we are dealing 
der "ow individuals under a special 
ay circumstances. In the first place, 
"i ate, 20 military service, during a 
ae of intensely active warfare, and 
Du X indication of an end to hostili- 
actiy Тапу of these men had been on 
Du baci for several years. They had 
of th away from home, practically all 
of t em outside the continental limits 

he United States. More than half had 


been in combat areas, and most of these 
under combat stress. 

Secondly, these men (during the 
period they were studied) were patients 
in a neuropsychiatric hospital. This 
means that they were temporarily re- 
moved from a situation of imminent 
orders to combat duty, and in this sense 
they may have felt protected. For at 
least a few, as we shall see, hospitaliza- 
tion meant a challenge to demonstrate 
adequacy or normality. 

Certain of the items in the question- 
naire administered to the men are of in- 
terest in this connection. 


Why are you in the hospital? Twenty-six men 
(36 per cent) write simply "Epilepsy" or "Epi- 
leptic." For these men, this single concept seems 
to account adequately for their present situation. 
Another 15 men (21 per cent) use the term 
"epilepsy" or “epileptic” together with some 


elaboration. Examples are: “Epilepsy (they 
say)" “Suspicion of epilepsy, “Diagnosis is 


epilepsy (Jacksonian),” “I'm in the hospital at 
present\ because гт believed to have epilepsy.” 
This second group, who elaborate somewhat on 
the word “epilepsy,” betray at least some doubt 
that the single diagnostic term will suffice as 
an accurate statement. One patient writes: "For 
drinking too much whisky, causing me to pass 
out; they have me in for epilepsy." Another 
omits the term epilepsy, but states: “Because I 
passed out. People who saw me said it was à 
fit. I don't know, outside of feeling a little 
groggy afterwards, I fecl all right." 

Over half the patients, then, bring in the 
word “epilepsy” in accounting for their hos- 
pitalization. Ten more use terms just as simple, 
such as “blackout spells,” “hazy spells,” “uncon- 
scious spells,” “fainting spell,” “for passing out,” 
etc. Only a minority discuss their hospitaliza: 
tion subjectively, i.e.» in terms of the experience 
which led to medical attention, Illustrations of 
these are: “I have fainting spells and don’t 
know what happens,” “Because I had a fit while 
working,” “For passing out, reason I don’t 


know.” 

A conclusion from the characteristic 
answers to this question about the reason 
for hospitalization is that these men 
regard themselves as having something 
(namely, “epilepsy”). They are in the 
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hospital not so much because they need 
help or need study, but because they 
have been diagnosed as epileptic. Not 
all the patients are willing to accept this 
diagnosis, but most realize that it has 
been, or may well be given them. In 
evaluating themselves in this way they 
use not their own but an outside frame 
of reference. 


A second item in the questionnaire 
asked How soon do you think you 
should go to duty? followed by What 
type of duty do you prefer? 

Twenty patients (38 per cent) either gave no 
answer or said "don't know." Ten men (14 per 
cent) wrote "Never" or some other form of 
definite negative answer. Nine wanted duty 
limited to the U.S. (“stateside”), One man wrote 
the words “As soon as I am” and crossed them 
out. A quite different group of 16 men (22 per 
cent) were outspoken in asking for duty im- 
mediately: "Any time, repair ship"; “To the 
battle zone.” An extreme illustration of this is 
M. R., who wrote as his preference, “Hazartious 
duty in underwater demolition team.” 

A third group of patients, 14 in all 


„(19 per 
cent), leave the matter of returning ‘to duty 
up to the Navy or the hospital: “When the 


cause of my spells has been determined, flying 
or aircraft maintenance”; “Whenever the doc- 


tor advises, hospital work”; “When the doctor 
says I am well"; "Up to the doctor, wherever 
I am put"; "When cured"; "Go any time when 
doctor thinks so"; “To duty when I am cured 
of what 1 got”; "Combat duty, when proven 


I haven't got it [epilepsy].” 
These replies indicate that a group 
of men hospitalized | for convulsive 
phenomena have a Tange of attitude 
about further active duty, with a larger 
proportion than one might expect ex. 
pressing preference for active and even 
combat duty immediately, or “as soon 
as the doctor Says so.” There seems to 
be a high degree of motivation in a size. 
able number of these patients to demon- 
strate that they are not inadequate or 
incapacitated by “epilepsy,” whether 
they “have” it or not, 
Replies to personality que. 


Stionnaires, 
One of the test instruments 


used with 


these patients was the Cornell pelegier 
Index. In order to have some basis а 
comparisoz-—t': replies of the aaj 
sive вто fare presented їп к ААК 
terms of di proportion answering as 
to each question together with the po 
portion found characteristic of a Ei 
of 325 penitentiary prisoners studied : 
Wickersham (22). Only those items p 
presented on which the groups Mp 
with statistical significance at the «< 

level of confidence. si. the 

Comparing the penitentiary with the 
convulsive population, we sce that - 
former (as might be expected) have ba d 
to reform school, have been pres 
have gotten in trouble because of dri! in 
ing, drink heavily, апа have been "d 
mental hospitals. None of these is aa a 
of the convulsives. The prisoners has ў 
less stable work history. The p 
complain more of constipation даг 
though the difference is less than м = 
cent, of other somatic difficulties: 5 
vomiting blood, stammering, uneasit ag 
urinating in public, pain in the Qa P 
nervous breakdown. More of the pe 
ers can do good work while others cxi 
Watching, and more of them have a 8 
appetite, 

Naturally the convulsive patien 
plain more of fits, fainting ue o 
dizziness, They complain more of vert 
easily, of fatigue on waking, of 2 the 
headaches, of pressure or pain 1) 


: а them 
head. Also the patients regard ac 
ч еу fi М 


selves much more as worriers. T! ,peri- 
it hard to forget an unpleasant e mE 
ence, and more of them have the fee!" 
of being watched while at work. t 

These contrasts would sugges" ес 
the convulsive patient is more m 
tive, more neurasthenic in his 56 is 


ts cont 
anc 


hat 


15 

occupation than is the prisoner. such 
ч а jons, * 

more aware of bodily sensations the 


posso 
as cold hands or feet, twitching 


г ЗЕР 
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а TABLE І 
IFFERENCES BETWEEN SVULSIV 
NCES BETWEEN CONVULSIVE GROUP AND GROUP OF 325 PENITENTIARY PRISONERS 


TAIN ITEMS CORN 


ELL SELECTEE 


INDEX 


Per Cent “Yes” 
Qué dons p = 
Convulsive > 

= Patients Prisoners 
Brie ever had a fit or convulsion? 75 6 
DU pope ey get up tired in the morning? Bo 5 
Dova ne it hard to forget an unpleasant experience? 58 P 
y 1 often shake or tremble? А 35 eh 
Я vou get du easily? Mi 38 
worry about your health? % 
Ro yuu often have spells of dizziness? FA 18 
үс ух u easily upset or irritated? dd ds 
ie og been troubled with shyness? 44 26 
Sn get spells of exhaustion or fatigue? 43 21 
D6 oon ш have nightmares? | 41 23 
PE n SHE ends quee pa s in ше head? 40 19 

я а s had a twitching of the face, head, ors s? 3 
E you frequently feel faint? 5 лаш 5 F 
кушт badly from frequent severe headaches? 33 x 
lave УБ me more than five jobs in the last two years? 1 20 
ere I een arrested more than three times? 6 65 
ts an ne er a patient in a mental hospital? 3 15 
Do wird pelor ever told you you had ulcers of the stomach? I 6 
Java Sau k more than two quarts of whiskey a week? | I 22 
of quu вмег gotten into serious trouble or lost your job because | 
king? | 

о you use dope regularly? * o 8 
o | 38 


ere y. : 
€ you ever sent to a reform school? 


trembling, 
Never- 


зац, face, or shoulders, 
atigue, and general irritability. 
haps. 73 per cent of the convulsives 
eel well and happy, 81 per cent make 
friends easily, feel that they are usually 
treated fairly. 

A second test instrument utilizing the 
questionnaire method, the MMPI, con- 
sists of items related not only to somatic 
complaints, but to a variety of interests 
эп activities as well. Items of the in- 
Yentory? on which the convulsive group 
answered “True” in significantly greater 
ie ен than the “normal” standard- 
Th. group (N= 139)* аге presented in 
signif 2 and Table 3. The criterion of 
icance is a difference at the .01 


Bass 

Ted x important to consider that only those 

toward the MMPI were used which contribute 
UH a score for one of the main variables. 

Wa hu author wishes to thank Dr. Starke Hatha- 
Y for his kindness in submitting data on the 


Stand LH 
lardization group. 


& 
level of confidence or better. 

A glance at the pattern of differences 
between the convulsive patients as à 
group and the normal group reveals cer- 
tain major areas of importance in the 
psychology of these patients. 


the convulsive patients are 
much more inclined to admit dizzy and fainting 
spells and fits and convulsions than are the 
controls. They report head complaints with 
uch greater frequency. 
b, They feel generally 
are less sure of their memory, their judgment, 
their ability to concentrate; they have a greater 
tendency to forget what people say- 

c. In greater frequency also, the patients re- 
bjective phenomena such as hot spells, 
f burning and itching, cars 


d. Understandably, 


m 
less adequate. They 


port su 
dermal sensations О 


ringing oF buzzing. 
d. Their sleep is much more troublesome than 


is that of the controls. This includes more 
dreams, nightmares, and sleepwalking, as well 
as insomnia, sensitivity to wakening, etc. Fewer 
of them feel well rested in the morning. 

e. The patients tire more quickly, are less 


able to work. 
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TABLE 2 


— 
MMPI Items ох WHICH THE PROPORTION ОЕ CoxvuLsivEs ANSWERING “TRUE” IS 
SIGNIFICANTLY GREATER THAN THAT OF CONTROL SUBJECTS 


a Ws 
Per Cent Answering “True 


Statement 
Ten Convulsive Control 

Any man who is able and willing to work hard has a good chance | 89 

of succeeding. 100 3 
I would rather win than lose a game. 99 oF 
I have often had to take orders from someone who did not know | А 

as much as І did. 63 qe 
I have periods of such great restlessness that I cannot sit long in 

a chair. 60 37 
Sometimes I become so excited that I find it hard to get to sleep, 60 33 
I frequently notice my hand shakes when I try to do something. 57 : 
Parts of my body often have feelings like burning, tingling, crawl- 

ing, or like “going to sleep.” 53 es 
I forget right away what people say to me. 2 I 
Most of the time I feel blue. 30 § 
I cannot keep my mind on one thing. 29 13 
Much of the time my head seems to hurt all over. 27 4 
I have had periods in which I carried on activities without know- 

ing later what I had been doing. 27 9 
Often I feel as if there were a tight band around my head. 23 5 
I feel weak all over much of the time. 21 6 

ave nightmares every few nights, ai 5 
I have the wanderlust and am never happy unless I am roam- 

ing or traveling about. ag « 6 
I find it hard to keep my mind ona task or job. 21 yd 
Once a week or oftener Í become very excited: 20 6 
I dislike having people about me. 19 4 
At times I have fits of laughing and crying that I cannot control, 13 а 9 
Once a week or oftener I feel suddenly hot fill over, without appar- i 

ent cause. їз A. 


` Bgestion of confusion, 
in that more of them „report that things some- 


times seem unreal, their thoughts race ahead, 
A small but significantly greater percentage 
out knowing where 


y about their 


health than do t but fewer have 


financial and other worries, 


Projection of the self 
Schach theory suggest: 
vidual's concept of h 
vealed in the moveme 
ence to Figure 3 (p. 
including human, ani 


in fantasy, Ror- 
5 that the indi. 
imself is best re- 
nt response, Refer- 
8) indicates that, 
mal, and inanimate 


movement, the convulsive patients ko 
litle (40 per cent of them use non 1- 
Piotrowski feels that movement (рг 
larly human movement) represents as 
cern on the part оѓ. the patient for nci 
future—for future possibilities. ane 
of movement in this group of convulsii 
Suggests caution, an unwillingness (0 ' it 
the Rorschach situation expressively; as 
may be inferred that the patients ar® to 
а group, repressed and confused ^ 
their role in life, However, it 15 a me 
esting and pertinent to examine in 50 


es 
| -esponse 
detail the nature of movement ч the 
Which appear in бо per cent 0 
records, й 
ds ntane 


Human movement (the most SP bject® 
ous form of all) was used by 22 SU 


о 
: (30 рег cent). Of the total number 


т cen 
human-movement responses, 64 Pe 
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were in response to Card III, which is re- 
garded by all Rorschach workers as most 
provocative of the humz»2»ovement re- 
sponse. These responses ar ' 


me people picking up something 
б people working 
o persons, kind of bending over 
b people, but I don’t know they're doing - - - 
1 down (tying to jitterbug) | 
е, people sitting over a ше... their 
бу. 5, trying to Keep warm 
о" persons standing close to a fire, like warm- 
ing their hands 
child's drawing of a couple of (colored) people 
(leaning) 
а design of people doing some kind of a dance 
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two people pulling something 

two men pulling something 

couple of people doing a dance together—danc- 
ing team 

waiters arguing over a spilled tray ` 

two people doing something 

two people pulling on something . . - trying to 
get it away from each other.. Could be a 
man, they both look like women 

two men trying to pull something apart 

form of two people, fighting, pulling away from 
each other 

two people washing clothes 

two people doing anything 


Of the remaining Rorschach cards, 
three (Cards I, VI, and VIII) produced 
no human movement, Card IV produced 


TABLE 3 


MMPI ITEMS ох WHICH THE PROPORTIO 
SIGNIFICANTLY LESS THAN 


N OF CONVULSIVES ANSWERING “TRUE” IS 
THAT OF CONTROL SUBJECTS 


Per Cent Answering “True” 
Statement " 
а Р; Convulsive Control 
І like to visit places where I have never been before. ә 81 | 95 
ae to be about as capable and smart as most others around me. Зо 04 
аро as able to work as I ever was. 73 2s 
In leve women ought to have as much sexual freedom as men. 70 8 
1 Ке little or no trouble with my muscles twitching or jumping- 66 88 
jd hands have not become clumsy or awkward. 66 86 
ey ever feel pain in the back of the neck. 64 86 
о not often notice my ears ringing or buzzing. 63 81 
y judgment is better than it ever was. 63 87 
y daily life is full of things that keep me interested. бі" 9r 
am always disgusted with the law when a criminal is freed through 
I ШЕ arguments of a smart lawyer. бт 53 
elieve I am no more nervous than most others. 60 $3 
am neither gaining nor losing weight. бо б 
aydream very little. 59 79 
do not tire quickly. 54 ЕЕ 
Seld very few headaches. 53 " 
js om worry about my health. |. 53 i 
the read for a long while without tiring my eyes. 49 io 
S id to be in a crowd who play jokes on one another. 49 7 
5 dom or never have dizzy spells. 44 2] 
ave never had a fit or convulsion. m 
almost never dream. zm 2 
S against giving money to beggars. 2 a 
orry over money and business. 26 a 
PRN never had a fainting spell. 2 dd 
Sed to like drop the handkerchief. 4 б 
ауе never felt better in my life than I do пом. en A 
I ees unusually large amount of water every ау. a a 
ТД ed “Alice in Wonderland" by Lewis Carroll. ч 3 
walking I am very careful to step over sidewalk cracks. 11 29 
mould like to be a soldier. Ir Ys 
Т pm strongly attracted by members of my own Sex. то ар 
MS à great deal of stomach trouble. ва Вен 4 § 
dus is turning out just like the prophets of the Bible sa k E 
z 9 


think I would like the work of a librarian. 
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one (“а man’s feet, he's sitting on some- 
thing”). Five cards produced two each 
(Cards II, V, VII, IX, and Xy Card П 
(two people playing “pease-porridge-hot з 
and “design of tivo people dancing”); 
Card V ("the hips, legs there, . . . spread 
out” and "couple of men lying on a hill- 
side"); Card VII ("two old ladies looking 
at each other" and “a couple of dancers 
again, comic costume, back to back"); 
Card IX (“a woman giving birth there" 
and “the Devil having an argument with 
himself"); and Card X (“somebody play- 
ing pinochle” and “over here in the blue 
you see a woman bending down, on her 
hands and knees . . . looks like she's look- 
ing at the back of a man’s head, who is 
in a reclining position, and then there's 
another man, and a baby, lying with his 
neck stretched ош”). 

A general impression from these hu- 
man-movement responses is that theré is 
to most of them, again, a quality 
restraint: people are working, 
something, bending, warming themselves 
at a fire, or busy doing anything at all, 
For a few patients the action is aggressive 
—people are pulling against one another, 
pulling something apart, even fighting. 
By comparison with the human move- 
ment characteristic of normal indivi- 
duals, there seems to be, for these convul- 
sive patients, a higher degree of flexion, 
suggesting hesitancy and caution. 

So far as animal move 
cerned, the convulsive patients, when 
compared with the control group, re- 
ported little. As conventional interpreta- 
tion would have it, these patients are 
less infantile in their impulsiveness than 
are However, 


of 
Picking up 


ment is con- 


the controls. 
among the patients 
human movement, 
Twenty-five patients (34 per cent 
animal movement, Of this 
ment, $0 per 


there iş 
more animal than 


) gave 
animal move- 
cent was given for Card 


к 
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; in a rou- 
УШ. This would be expected in a к 
ecords, beca 
tine group of Rorschach records, be 


Saas ing 
of the provocation of animals lu 
imbi ati rawlings 

somethin climbing, eating, ст 


it ‘ ll 
: Vil. . — rast to à 
etc.) whi lhis card has in contr 


bra я responses 
the other cards. These are the inani 
given for Card VIII by the conv 
patients: 


bears trying to climb up 

climbing animals Р 

wildcat crouched, ready to spring 

lizards climbing a tree 

rats, or mice, climbing somewhere thing 

two animals climbing up on some neplace 

two animals crawling along, going Sm insects 

a couple of bugs crawling on a s , 

two animals probably climbing a plan 

two animals creeping up | 

looks like a couple of bears trying 
somewhere 

two animals nibbling at a tree 


imb 


:devable 
"n ТА derab 
Here, it is seen, there is cons! 


$ 

i imbi attemp 

emphasis on climbing, and the 

to climb. . " 
~ ic ted 

Next to Card VIII, Card X elici entre 

s vert 

greatest number of animal-moven 

sponses, nine in all. These are: 


two animals hiding in a tree 

two deer floating.. , jump 

two birds flying along here 

caterpillars going up a tree or branch 
animal, gnawing on trees 

animals fighting gy bid 
an antelope, on his hind legs, "on his 
insects eating on a stalk А 

animals eating around some stains 


etaway 


s involve 
ment responses, all of which in 
ing or flight: 


at you 

a bird, or such, flying . . . coming idi 

a bird, flying 

a flying butterfly 

moth or butterfly in flight 

а bat flies around " 

looks like a bat, spread out, flying 
air 

a bat, in flight 


th 
through 
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For Card I (which brought forth five 
animal-movement responses) flight is 
again in evidence: 


a flying animal, a bat 

a flying bat 

blood-sucking bat, wings spread 
crawling bug of some type 

a bat, in flight ° 

Cards III and IX provided no animal- 
movement responses. Of the remaining 
cards, II gave three ("two bears stand- 
ing and facing each other"; "two ani- 
mals, got their noses together, straight 
up in the air"; and "two butterflies, in 
flight’). Two were elicited by Card УП 
( two: dancing dogs” and “two objects, 
with a butterfly resting its wings on 
them”); Card IV had one (“a serpent, 
coming out of a hole”), as did Card VI 
(“a flying squirrel”). 

From these animal responses we may 
conclude that expression is cautious and 
tentative. There is much flying, crawling, 
leaping; in other words, effort against 
the force of gravity which, rather than 
aggressive, is defensive. 

Inanimate-movement responses are ex- 
pressed by the convulsive patients in 
Most abundance on Card УП. (It will be 
recalled that this was the achromatic 
figure most rejected.) There were eight 
Such responses: 


2 е 

Бак thunderhead . . . boiled up, dark 

owing smoke 

ooks like a ship burning, Or something like 
that 

tw ia i 

се Indians looking at each other 
attering of a snowball, against a wall, splashed 
or smashed 

a i j | i 
n animal taken apart and just laid all over 

à there 

broken clouds, or chain 


раі 
Pair of clouds, closing down at the base 


Clouds or smoke, on Card VII, are fre- 
quent responses with “normals” but this 
combination of diffusion with inanimate 
Movement (suggesting free-floating anx- 
tety) is impressive. 
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Card X was next in order in evoking 
inanimate-movement (six responses): 
two spiders" stepped on 
greenish chain, like you pull in older times 
two worms fastened together 
spiders hanging outside a tree 
crabs, hanging on to some kind of animal 
rabbits head, fluid coming out of the eye- 

sockets 

Here again, there is a striking empha- 
sis on things suspended ог falling, 
squashed, or otherwise subject to gravi- 
tational force. 

Card II, with five inanimate-move- 
ment responses, elicits the following: 

a mashed bug 
an explosion, something burning, flame coming 


out 
a crawdad, smashed out 
clowns, tied together 
something disfigured, mutilated 


Here, for Card II, the feeling of catastro- 
phe suffered —already accomplished—is 
ө 
very strong. 

There were four responses utilizing 
inanimate movement for Card IV. 
a fountain (spraying) 
dark clouds, separating before thunder 
animal, his eyes popping out 
tree, branches bowing over 

'There were four also for Card IX: 


something squashed 
water has eaten away the land 
an oil ше... something burning . . 


of heat . . · 
looks like а waterfall 


. a lot 


The remaining movement responses of 
an inanimate sort were: three for Card 
ш (“a couple of animals hanging"; 
“plack ink smeared”; and “two men, 
locked together") and for Card VIIT 
("two animals stretched out"; "a flare 
from an explosion"; and "a forest fire, 
in technicolor"); two for Card I (“а 
squashed beetle" and "a plane, burning 
up") and for Card VI (“ап altar, lighted 
ар...» sparks coming out” and “Christ! 
looks like somebody took a man down, 
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- - . laid him open . . . his buttocks out, 
and left his penis hang"). 

Parental identification and discrimina- 
tion. Within recent years, considerable 
attention has been given by some investi- 
gators to the differential response to in- 
dividual Rorschach cards. In particular, 
Card IV, considered to be the masculine 
or "father" figure, has been compared 
with Card VII, the "mother" figure. 

In the discussion of control it was 
shown that Card VII (the mother figure) 
is the most rejected card while Card IV 
(the father figure) is rejected much less 
frequently. On the basis of this finding 
alone, one might conclude that these con- 
vulsive subjects are more inhibited by 
the figure of the mother, or the feminine, 
than by the masculine. 

We have seen that inanimate move- 
ment responses (m) were given most fre- 
quently for Card VII, the mother 
Since m responses are regarded as revea]- 
ing anxiety, we might infer that anxieties 
regarding the feminine role and one's re- 
lation to it are prominent in these con- 
vulsive patients. Those concerning the 


masculine role and figure reveal less 
anxiety, 


figute. 


A somewhat more detai 


led analysis of 
responses of these 


convulsive patients to 


portion: 


PERCENTAGE ОЕ Torar RESPONSES 


Response Card IV Card VII 
(N —89) (N=91) 
Rejection 
Human Movement (M) dus 26.4 
Animal Movement (FM) 2.2 4-4 
Inanimate Movement (m) 4.5 E: 3 
Third Dimension (Ё) 4.5 32.2 
Diffusion (K) RI ie 
Pure form (F) 48.3 15:4 
Texture (c and Fc) 14.6 DNE 
Shading (C’) IO.I 9.9 


It appears from this tabulation that 
i i j ў те 
convulsive patients reject Card УП то 


frequently tha» they do Card IV but A 
nan S | 
also react ¡(uch more actively to i 
. i + " ye- 
VII in otk «Tways: they give more mo 


ment—human (M), animal (FM), and 
particularly m (inanimate movement) 
They project more in the nature ^» d 
dimension (k) and diffusion (К). РШ 
form is much less for VII than it is 5 
IV. Other than pure form responses, " 
excels only in c and Fc (the texture E 
sponses). This suggests that these p^ 
tients are, in relation to the father fes 
not only repressed but cautious and Ww 
ful by comparison with their relation le 
the mother or female figure. ‘The ае 
figure seems to elicit an active particip? 
tion, either of flat denial or of effort, E 
intellectualize or otherwise rationalize. 
The male figure, on the other hand, h 
handled in a matter-of-fact мау, es 
caution and with kid gloves, but withor: 
excitement. re- 
Of the few patients (twelve) we * 
jected the father figure, half also won 
the mother figure, and the ^ 
four gave К or k responses (maps, clou? 
etc.). pt 
In handling the father figure aera 
ing the 6 who rejected it) the 24 eom 
Who rejected the mother figure bet 
fairly factual, realistic, and spontano ы 
We might infer that it is fairly ate 
acteristic of the convulsive patient 10 
ject the feminine while preserving o 
fairly well-integrated pattern of ae 
sonal) relationship with the mascu fost 
When this pattern of masculine relati о 
ship is distorted, as it is for а hip 
the subjects, the feminine relation” us, 
Seems also to be tenuous and AY a 
but reflected in intellectualization long 
method of defense, probably of 0 o 
duration, "The feminine image pg 
force on these patients projection, 1? 


P 
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spection, objectivity, detachment, and re- 
moteness, 

The self in the sexuc’sibsation. The 
convulsive patients gave f overt sex 
responses. It was noticed, htwever, that 
they frequently rejected Card VL the 
sex figure.” A fourth of the patients did 
this, and responses for a sizable group of 
the remainder were characterized by 
features of repression and anxiety of 
which F (49 per cent) and the frequency 
of C’ (black and white shading) sort of 
aon were the chief indicators. The 

Tesponse was the most frequent de- 
terminant other than pure form (Р). 
Characteristic responses of this sort are: 


à monument, a goddess, lighting Up, sparks com- 
ing out 
а camouflaged gun—fur 
a bear skin, sir—dark 
e Skinned hide—the color of it 
Eb skin (because of color and shape) 
man laid open, buttocks out, penis hanging 
А (and) а hide, shape, and color 
а pelt—shape and color 
коне tape and color 
bl X-ray—shape and color 
ack print of a lady—lungs 
i These responses are good form—in 
act, the hide or pelt is a popular re- 
Sponse. But the frequency with which 
Ше color of the figure partly determines 
Пе percept is high. 
‚ One might infer that, in the sexual 
s : É i 
SE ere these convulsive patients are 
> aia and_ repressive; the situation is 
angerous, and they are socially ill at 
ase and depressed. 
á The Thematic Apperception produc- 
a For purposes of tapping motiva- 
10па] factors in the personality of these 
C ; Р = H 
Onvulsive patients, the Thematic Ap- 
EE dpi Test was used. The stories 
о : 
ot d by the patients were scored by means 
T an adaptation of the technique recom- 
ended by Aron (2). 
+ In general, the stories were brief and 
еге; the typical patient was hesitant to 


give free rein to his imagination. Much 
of the content was simple description, 
with dynamics or action quite secondary. 

For five of the pictures, stories were so 
stereotyped and homogeneous as to be of 
little use in the present analysis. Non- 
productive pictures were, as Stein (20) 
describes them: 

Picture 3. On the floor against a couch is the 


huddled form of a boy with his head bowed 
in his right arm. Beside him on the floor 
is a revolver (20, р. 3)- 

Picture 9. Four men in overalls are lying 
on the grass taking it easy (20, p. 7). 
Picture 12. A young man is lying on a couch 
with his eyes closed. Leaning over him is the 
gaunt form of an elderly man, his hand 
stretched out above the face of the reclining 
figure (20, P- 8). 
Picture 14. The silhouette of a man (ог 
woman) against a bright window. The rest 
of the picture is totally black (20, р. 9). 
Picture 17. A naked тап is clinging to a 
rope. He is in the act of climbing up ог 


down (20, р. 11). 

9 

The remaining five pictures were con- 
siderably effective in eliciting material 
suitable for analysis. These were pic- 
tures 4, б, 7, 13, and 18. 

In order that the reader may have at 
least a rough norm for comparison, 
Stein’s description of what is usually seen 
by the young adult male patient will be 
given for each picture as it is discussed 
here in connection with the performance 
of convulsive patients. 

Picture 4. (“A woman is clutching the 
shoulders of a man whose face and body 
are averted as if he were trying to pull 
away from her.”) According to Stein: 

The stories to this picture are usually con- 
cerned with a conflict situation between the 
couple in the foreground. The man may 
desire to leave the woman because he has 
a plan which he wishes to put into action 
but the woman wants to keep him with her. 
The conflict may be stated in general terms 
as an “argument” or the story may involve 
the “eternal triangle” with the seminude 
figure in the background as the man's mistress 
or girl friend, These stories frequently re- 
flect the patient's difficulties in marital ad- 
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justment or his attitudes toward women and 

sex (20, p. 4). 

It was characteristic of the convulsive 
patient not only to be sensitive to the 
conflict between the man and the woman 
in the picture, but to be aware of it 
intensely. He revcaled himself as belong- 
ing to one of three groups, depending on 
which sex was finally dominant in the 
Story: the man or the woman. It hap- 
pened that of 71 patients, 27 belonged to 
the male dominant group and 27 to the 
female dominant group. Seventeen were 
ambivalent. Typical stores are: 


(Male dominant) 


Well, the man is about to do something 
that the girl doesn’t like, apparently. 

She’s trying to keep him from going ahead 
and doing it. He might be mad at somebody 
++ + going to beat him up. It resembles a 
movie. . . . She's trying to restrain him. From 
the look in his eyes, it looks as if he's got a 
mind of his own. А 
(Female dominant) 

This might have been an affai 
and he's evidently gonna shove off on her 
or leave her, and she's evidently in anxiety 
that he's gonna leave and she doesn't want 
him to leave. From the expression , , , (Will 
she be successful?) I think she will. There's 


not quite enough expression of determination 
on his face. 


rofa couple, 


(Ambivalent) 


Well, I can see that the m 


ап is mad, and 
the woman is tryin 


8 to soften him 8р; usi. 
Whether I can tell a story, I don't know, |, . 


Arguments сап start Over almost anything, 
(Will she be successful?) Well, I imagine she 
will, . . . they generally аге... although I 


don't know, . , . He's kinda wild-eyed, stub- 
born, ,., 


(Second illustra 


«uw ТЕ 
looks like this ma 


been out with another 
is his wife here, want- 
home, He's undecided, 
€ outcome will be, 
In the light of the а 
the convulsive patient t 
tification with 


ear tendency for 
9 reveal his iden- 
the masculine, with the 
feminine, or both, it becomes i 
to examine any differential i 
to subsequent pictures, 


nteresting 
n response 


Picture 6. ("A short. elderly x 
stands with her back turned to a я 
young mangelatter is looking cnm 
ward with (perplexed ваше а 
cording to еіп the scene is stru 
in this way by young adult males: 


in 
The elderly woman and young ie an 
this picture are usually seen as pe ng his 
son. The son may be seen as as E he 
mother's permission to do omen nan Ч sant 
had planned for a long time. He im another 
to leave home to undertake a job "E armed 
city, to get married, or to enlist 18 PES his 
forces, His desires usually conflict i told 
mother's, In most stor we кте om re- 
how the conflict is resolved. These i mother 
flect the patient's attitude toward his d fric- 
and the factors which may have cause 
tion at home (20, p. 5). 


E ir 
а коле inwte! 
Among the convulsive patients ге фе 
Stories for Picture 6, aggression ms by 
(Dress! 
son toward the mother was expres oup; 
inga от 
56 per cent of the male-dominant P ant 
37 per cent of the renee 
group, and 29 per cent of the wares д 
group. This is a story characteris 
aggression toward the mother: | 
Evi- 
п. " 
That looks like a mother and mother is 
dently he's done something that his Sind like 
disappointed in him. . . . She's s: but 
she doesn't want to talk to him now, 


Жыр ‘ дуз 00687 
think in the end—like a mother alway 
she'll take him back. 


or 


ES sion 
However, mood qualities of ten the 


of dejection were prominent 1n Din 
ambivalent group (29 per cent) — 
11 per cent of the male-dominants ale 
was absent in g6 per cent of the ge 
dominant group. In the female-dom! am 
8гоир it was characteristic (in con inr 
son with the other groups) for the mo one 
to have suffered at the hands of pe 

else (not the son). Also, there s ag 
tendency for the son to be subject ther: 
Sression or dominance by the m tory 
quite consistent with the SOLE x 9 
told for Picture 4. This dominance any 
Mother over son also characterized ee 
of the stories of the ambivalent 819 


є 
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. Picture 7. (“A gray-haired man is look- 
Ig at a younger man who is sullenly 
staring into space.) By to.) rison with 
the mother-son picture (No. È the stories 
iking con- 


told for Picture 7 were in 
tras 1 : 5 
РА t. Stein describes, as typical of the 
you : и 
| ng adult male in the service, the fol- 
IDWIBI еее екеу м 
ving as characteristic of Picture 7: 
T ^ Е 
ins he younger man is frequently scen as hav- 
ns come to the older man for advice or the 
in en ше discussing a. problem of mutual 
Bait These stories frequently indicate the 
es attitude toward adult males and 
an some of the problems about which he 
ii be concerned. At times the stories 10 
04 picture reflect the patient's attitude to- 
ard therapy (20, p. 5)- 
A à à 
h i the convulsive patients, there 
i almost no aggression on the part of 
ле : е 
son; for all three groups (male- or fe- 
ih and ambivalent) the 
heme i 3 
E ie is one of dominance by the father 
and of ае ` 
E of affiliation with the father by the 
son. There is, i 
There is, in general, an absence of 


male-dominant, 


th " net я 
s tension and dejection which char- 
erize the stories told for the mother- 
Or 3 а p 

"tà figure. Here is a typical story for 
Icture 7. 


NE 3 

a it looks like it may be a father ad- 

мылы his son—something his son is very in- 
rested in—taking it all in. 


ie тз. (“А young man is stand- 

arm ce downcast head buried in his 

Pt pss him is the figure of a 

male ч ying in bed. ) For the normal 

Pictur : the service, according to Stein, 
€ 19 is treated as follows: 


No plots are most frequent in the 
is ind fie to this picture. The young man 
had a y seen as contemplating or having 
thie Mai intercourse with the woman on 
wife. d. The woman may be the young man's 
VE girl friend, or а prostitute. These 
toward usually reveal the patients attitude 
ards women and sex. 
ja aiher frequent theme is that ‘the: yor” 
is eels the bed is the young man’s wife, who 
ings her sick or dead. The young man’s fcel- 
des then described. ‘This theme usually 
iis ates the patient's hostile attitude towards 
5 wife or women in general (20, р. 9)- 


In their stories for Picture 19, the 
group of patients who (for Picture 4) are 
female-dominant reveal least need sex: 
15 per cent vs. 21 per cent for both the 
male-dominant and ambivalent groups. 
Aggression toward the woman is promi- 
nent in the female-dominant group: 44 
per cent vs. 30 per cent for the male- 
dominant, and 15 per cent for the ambiv- 
alent group. 

Illness and death to the woman result- 
ing from actions (other than those of the 
hero) characterize 47 per cent of the 
stories of ambivalent patients, 30 рег 
cent of those female-dominant, and 20 
per cent of those male-dominant. 

From the manner of dealing with Pic- 
tures 4, 6, 7, and 13, one obtains a strong 
impression that the convulsive patient is 
extremely sensitive to the possibility of 
conflict between the sexes. In fact, sexu- 
ality seems to be a matter of struggle— 
of battle—in which one or the other sex 
is victor. Catastrophe to the woman is a 
pervading theme, more characteristic of 
patients uncertain about sexual domi- 
nance or sensitive to female supremacy. 
We have, thus, some strong confirmation 
of the frustration-aggression hypothesis 
advanced by Dollard, Doob, Miller, 
Mowrer, and Sears (4)- 

Picture 18. (“А таап is clutched from 
behind by three hands. The figures of his 
antagonists are invisible.") Responses to 
Picture 18 were of particular interest be- 
cause we are dealing with the phenome- 
non of convulsion. The description of 
the picture and of stories it evokes in 
young adult males, according to Stein, 
are as follows: 


Patients are frequently concerned with their 
inability to develop ап adequate rationale 
for the three hands that appear in the pic- 
ture. In. the common stories the man in the 
picture is seen as cither drunk or having been 
in an accident and the hands belong to the 
people who are helping him. Or the hero 
is being attacked. [rom the rear and the hands 
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belong to his attackers, These stories reveal 
the patient’s anxieties concerning aggression 
that may be directed against him or the pa- 


tient’s attitude toward alcoholism or drug: 


addiction (20, p. 11). 


Within the groups of convulsive pa- 
tients, there were no significant differ- 
ences between subgroups divided (ac- 
cording to response to Picture 4) as male- 
or female-dominant, or ambivalent. The 
great majority of the stories described 
the central figure as experiencing "press" 
from outside, rather than needs within. 
ОЁ these, press Aggression was most fre- 
quent (39 per cent). (The hero suffers 
attack by another—he is hit on the head, 
beaten, or robbed.) Next in order was 
press Nurturance. (The hero is being 
helped, or carried, or otherwise cared 
for.) This characterized 27 per cent of 
the stories. A third Sort of press, ex- 


perienced by 17 per cent, was Affliction; 
the hero is ill or intoxicated, 


SUMMARY 
In this study a group of 72 convulsive 
patients has been compared w 
possible with “control” 
comparison has suggested 
ing to the dat 


herever 


personality is unique, or that 
indeed, a convulsive personality, 
For a few variables, the convulsive 


cted varia bility. 


tendency) and Mf 
(tendency toward interests of the op- 


posite sex) on the Minnesota Multiphasic 
Personality Inventory. This relative 
homogeneity on the part of the convul- 
sive patients for Digits and Arithmetic 


accompanies a lowered mean on these 
tests, something which, according to 
Rapaport 55-15 characteristic of a 
patients {mined at the Menning 

sin this it is inferred that the 
convulsives, so far as mental test perform- 
ance is concerned, are much like neuro- 
psychiatric patients in general. " 

The mean difference of the pev 
sive group from the controls for M? vi 
Ma is insignificant statistically, so t а 
this warrants по further comment. Mea 
deviation from the norm for Mf d x: 
8reat, however, as that for any i а 
variable of the MMPI. This — 
that, so far as interests are concerne 
the convulsives are like the opposite i 
and quite uniformly so. This is Бех 
tent with the fact that their mean Poe 
file for the MMPI is much more li t 
that of the control females than like tha 
of the control males, ives 

Intellectually, the group of convi aa 
(with a mean TQ of 98) does not di " 
from the genera] population. EM 
5 per cent perform like mental deficiet d 
16 per cent (including one of the bcr: S 
deficients") perform in a manner W^ by 
according to the criteria suggested jue 
Wechsler (21), is indicative of "loss m 
presumably to brain damage. (What P iz 
Portion of the control or “normal” poP n 
lation demonstrate such loss is not show 
in Wechsler’s data.) 

In their intellectual performances, е 
ticularly with Digits and Arithmetic, =i 
convulsives reveal anxiety, which Par 
Sumably serves to reduce in general eon 
effectiveness in the mental test акау 15 

So far as ego structure, or owe 84 
concerned, there is strong indica ‘on 
that, at the level of conscious opel oe 
the convulsive patients as a ee 
extratensive; they deviate from ihe m 
mals more on the “neurotic” variab ai 
the MMP] than on the “psychotic: Vf 


par 
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E ie deviate in the direction of 
eminine interests and personality struc- 
v as this may be je red by the 
ea profile. Extratensio? ds shown 
к by the ratio of ап move- 
wiih тщ of color on the Rorschach, 
color predominating over move- 
ment. z 
oii for explanation of these 
ena in terms of dynamics, the 
с data suggest that defense 
both Vra must be recognized at 
sive ker ie ios and the introver- 
Sadi = о the continuum. Extraten- 
tlie Ате patients show immaturity in 
ization of social techniques such 
Ed Lu diplomacy (as might be sug- 
n res a example, by texture responses 
: orschach); they tend to preoccu- 
нер with somatic difficulties (as indi- 
башат шо to the MMPI and par- 
Кый y the Cornell Selectee Index) and 
ing ad = personal inadequacy, verg- 
are lon rag neurotic depression. ‘They 
аз ely people, who lack sophistica- 
Е and savoir faire, and rely on illness 
and inability to justify their isolation. 
ne : the introversive side, however, 
in i evidence also for a rationalizing, 
of ie sort of defense. Many 
ig Шот. patients were remarkably quick 
апы Т their current life situation asa 
boicot of Baving been diagnosed by 
rene. else as “epileptic. Rational ac 
ie ie of this sort was utilized in 
e orschach situation by a tendency to 
"l^ and other intellective responses. 
by the demonstrated more conclusively 
meni: Utilization of inanimate move- 
Nm of spontaneous human 
Epl m or the primitive, impulsive 
Sensitiy movement. These patients are 
selves : to strong forces within them- 
Шеш but they are unwilling to accept 
Prom as their own. In the face of these 
ptings, they are moved, therefore, 


to depersonalize them, to see them as out- 
side influences, abstract and symbolic. 
Seeking further—to ask what lies be- 
hind this adjustment which seems com- 
pounded of self-doubt, self-denial, and 
uncertainty—the psychological data give 
certain motivational clues. The Ror- 
schach protocols suggest strongly tha@the 
situations of particular threat to these 
convulsive patients are sexual in nature; 
these men tend to reject sexuality out- 
right, to repress all spontaneity. Because 
complete repression is usually impos- 
sible, there breaks through an acceptance 
of sexuality which is realistic, but colored 
with a spirit of inadequacy and sadness. 
Their responses to masculine and 
feminine figures of the Rorschach sug- 
gest further that these convulsive pa- 
tients have acquired a fairly realistic and 
n integration. with masculine 
possibilities; in their man-to-man rela- 
tionships they are passive, but cautious 
and tactful and generally at ease. Their 
relationship ta feminine possibilities is 
in sharp contrast. In the heterosexual 
situation, the initial reaction of these 
convulsives is repression and active re- 
jection. The aggression with which this 
rejection. takes place is revealed in the 
active manner with which they deal with 
the feminine figure, through projection. 


With the feminine figure, in an atmos- 
ectualizing and abstract 


lizing, movement comes 
d. But it is not human 


functional 


phere of intell 
ing and externa 
into the foregroun 
movement which dominates the picture; 
it is depersonalized, inanimate move- 
ment. In the heterosexual situation these 
patients are not only anxious to quell 
their anxiety, but they feel called upon 
to take action of some sort. 

These impressions of threat in 
heterosexual situation are reinforced by 
the stories told for the TAT pictures. 
Here it is characteristic that man-to-man 


the 
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situations are fairly relaxed, objective, 
and impersonal. The hero is usually pas- 
sive. When women are involved, the hero 
is aroused, emotional, and under pres- 
sure to do something. While the number 
of patients who revealed dominance and 
the number who revealed submission in 
the heterosexual situation are equal (with 
a sizable group ambivalent), it was the 
submissive group of patients who re- 
vealed the greater aggression toward the 
woman, and the lesser degree of simple 
need sex. 

The convulsive patients showed, in 
their TAT responses as well as in the 
Rorschach protocols, a high degree of 
sensitivity to conflict between the sexes. — 
a battle in which one sex or the other 
is the victor. Very often the final result is 
catastrophic to the woman, though not 
always because of the man's behavior. 

These findings suggest that the psycho- 
dynamics of identification with the ma- 
ture masculine role is somehow distorted 
or off balance for many of these patients, 
One might ask as to their early history 
in terms of experience with parents, 
About a third of them lost at least one of 
their real parents before the age of six- 
teen, the majority of these the father 
(through death in nine cases and by de- 


sertion, separation, or divorce. in is 
more). In addition to this obvious ev, 
dence of disesz:ion to the family unit 
there is & ence in many more of h t 
histories j parental conflict, and e 
“nervousness” or "spells" on the part 0 
parents, particularly the mother. " 
The fantasy of these patients as in : 
expressed in the Rorschach, and ре z | 
larly the TAT, suggests strongly ae 
they are confused about sexual roles, on 
they have failed in many instances to ч 
tegrate within their personalities а та” 
culine identification that is maturely © 
fective in heterosexual cane Р 
They seem frustrated by the [ла eit 
they are hesitant also to express unl 
aggression toward her directly. They by 
tempt to dissipate this aggression, uu 
repression (which usually does not w e 
then by rationalization, Here again th t 
are unable to achieve a satisfactory uu 
and it is in this setting that illness a 
tributed by the patient to forces gus eS 
himself and beyond his control, pras X 
in the form of “fits,” which finally d 
come completely justified for S ай 
them by the diagnosis of “epilepsy: jent 
though it is characteristic for the pat its 
to want to disguise this because ү ; 
implications vocationally and socia 4 


smeg 


12 
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I. PLAN OF THE STUDY 


A. PURPOSES OF THE STUDY 


In the period 1945-1950, American col-* 


a crowded with students, a large 
Vona о of whom were veterans of 
сота ar П. In part, the influx was an 

of a new feature in the educa- 


tion š NP 
al scene— the educational provisions, š 


тем law commonly called the 
ai етм Rights. Many of these veteran 
йо, ps not have attended college 
ginnin е aid thus provided. At the be- 
piene T considerable concern was ex- 
combat regarding the possible effects of 
Service and of other features of wartime 
to the he oes the adjustment of veterans 
бе а jas of colleges typically designed 
body, 55 widely experienced student 
cs S perienne of university faculties 
simisti- emonstrated that the more pes- 
sity Due were unfounded. Univer- 
Veteran ers and deans reported that the 

$ were alert and industrious stu- 


1 This 


and т monograph is based on Chapters I, II, 


ТОД Adjustment to College: A Study of 
een Am eran and Nonveteran Students in Six- 
imiteq en Colleges (privately printed in à 
Vice, age ов by the Educational Testing Ser- 
Coleen The study was conducted by the 
Чисано пітапсе Examination Board and the 
C Testing Service with the support of 
строга 516 Corporation of New York. ‘That 
ion does not, however, necessarily en- 


dor, 
зе th r 
rein, € statements made or views expressed 


dents, that their influence on the under- 
graduate body was wholesome, and that 
the incidence of events that could be 
traced to battle shock was much smaller 
than had been anticipated. Numerous 


ts were presented. Vet- 


wy 
almost universally re- 


S ndation for the Ad- 
"Ming became inter- 
Ао the academic suc- 
х i=2Cudent in college, and 
the Colitge Entrance Examination Board 
was requested to make a study investigat- 
ing the relationship between veteran- 
nonveteran status and academic success 
in college. The College Board agreed to 
conduct such an investigation, with the 
support of the Carnegie Corporation. 
The primary objectives of the study were 
to answer the following questions: 

1. Do veteran students make better grades in 
college, in relation to their ability, than non- 


veteran students? 

2. What light does information about back- 
ground, attitudes, and other qualities throw 
upon veteran-nonveteran differences? 

. How do veterans who could not have at- 


tended college without the financial assistance 
provided through the GI Bill compare with 


veteran students who were financially able to 
attend college? 
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This report is concerned with the first 
of the three questions—the comparison. 
of veteran and nonveteran students wit. — 
respect to grades relative to ability. + 

The analysis of the data needed to 
study this question would furnish infor- 
mation relating to numerous other ques- 
tions of interest to educators. How well 
can scholastic success in college be pre- 
dicted from aptitude-test. scores and 
measures of high-school acnievement? 
What improvement in prediction can be 
effected by combining various predictors 
of college success? Are there differences 
between veterans and nonveterans with 
regard to the relative effectiveness of pre- 
dictors for forecasting college achieve- 
ment? Of what significance i~~ 
ential in time of taking apt’ 
relation to time of enteri 
veterans who enter coll: - 


Кы еп 


handicapped during th 0 
comparison with no A. а aat a 
warm-up or refresh „е X be 
desirable? In the v m "т 
whose education w, b 1e 
war, is a period ot x ^ ces- 
sary, or does he con = a with 
enthusiasm which leads to temporary 
overachievemen:t? Questions of this sort 
Were taken into account in designing the 
study. 
The best o 


а study pres 
1946, which 


combat Overseas) 
lege. It was felt t 


possess to a 
ristics which 


аж a 
erans, and would be sufficiently us 
sus to yield statistically stable results. 
X 
B. SELECTION or COLLEGES 


reter- 
Ii as desired that the study of ve 


ans Khievement in college be based оп 
data obtained from a variety of hi 
of institutions, including аг чане 
and men’s colleges, private colleges eh 
colleges supported by state or Lew 
pal funds, large and small me 
colleges with various curricular emp 28 * 
(such as liberal arts, engineering, ei 
agriculture), both heavily endowed ent, 
leges and colleges with less endowm Єб- 
and colleges representing various z 
graphical regions of the United leges 
Was also desired that pairs of 0 5 be 
with roughly the same characteris i. 
chosen. Further restrictions in the а 
of colleges included adequate dd 
of students, availability of suitable n 
and willingness of the college to p?! 
pate in the study. 


А ed t° 

A tentative list of 36 colleges which Mens 
meet the criteria for inclusion in the S dents of 
Prepared. Letters were sent to the pres of the 
the 36 colleges by Dr. O. C. Garmin, Xa 
Carnegie Foundation for the diee d P 
Teaching; each letter briefly describe а letter 
jectives of the study. A few days Tate pm 
and a brief questionnaire were sent 
College Entrance Examination Boar es in 
Same persons. Anonymity of the сое icutions 
published report was promised to the ant Y a 
Who wished to participate in the stl e pres” 

The questionnaire sent to the canran у nich 
dents was designed to provide informat? not 
would be useful in judging whether OF 7. 
institution Was an appropriate onc dequacy о 
in the study from the standpoint of 54 uniform 
data. It furnished a convenient anc num 
method for the college to report: (a) th entering 
of veteran and nonveteran stun ity in the 
cach college or division of the univers informe 
fall of 1945 and in the fall of 1946: C шелсё f 
tion regarding the program of inte names 0 
scholastic-aptitude testing, including пу taken 
16515 used, whether tests were x pe or 9 
near the completion of secondary sch e pr^ 
the time of entrance to college, а 
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ortie 
M cm having scores; (c) whether or 
a eie measure of achievement (such 
Joutinely aveils RA grade-point average) Ў 
specific сө а be for these students; (d) wh, 
Bye large es were taken in common by а) 
and (e) ser сар of the freshman stugh 
lastic pam SIE or not some measure 
йе pro S in high school was available?! 
question EUM of the entering freshmen. A 
the instit а: included to ascertain whether or not 

ution wished to participate in the study. 


Ty ы 
E [ане of the colleges indicated 
they wished to participate in the 


Veterans! - 
ans' study and returned question- ` 


ds Seem institutions could not or 
(OMNES Mia ee participate, and from the 
reply Жы three colleges there was no 
reply to Sec fee reply, with no 
colleges E ow-up letters. Nine of the 26 
Participar nich expressed willingness to 
cluded hae ш the study were not in- 
ОЁ cases ut of an inadequate number 
е studied 906 ог more of the groups to 
tain cruci; he because of the lack of cer- 
tained a information. Data were ob- 
Was dro m 17 colleges. One institution 
ata eo from the study after the 
ata we; een collected, since needed 
So that i available for too few students, 
Btoups ма statistical analysis 15 based on 
he hey colleges and universities. 
referred to icipating colleges will = 
Dames, Th i this report by code 
Pseudon € private colleges were given 
can emis i which are common Ameri- 
no attem Da assigned at random with 
implica to make the name carry any 
insti fides. as to any characteristic of the 
tutions, į apu publicly supported insti- 
pal е uding both state and munici- 
ames е were given geographical 
Witton describe in a general way 
Owing is PW the institution. The fol- 
Siving ы ist, by geographical section, 
tion of с code name and a brief descrip- 
ch institution: 


Easte 
"п City University: A coeducational pub- 


We Adams University: 
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licly supported college of arts and science located 
in an eastern city. 

A private university for 
Sen located in an eastern city. 

Stewart University: A private university for 
men located in a small eastern city. 

Miller University: A private coeducational 
university located in an eastern city. 

Midwest State University: A large coeduca- 
tional state university located in a midwestern 
city. 
Midwest City University: A coeducational, pub- 
licly supported university located in a midwest- 
ern city. 

Littletown State University: A coeducational 
state university located in a small midwestern 
city. 

Harris University: A private coeducational 
university located in a small midwestern. city. 

Evans University: A private coeducational uni- 
versity located in a midwestern city. 

Central State University: A large coeducational 
1 versity located in a small midwestern 


Sted in a midwestern city. 
iversity: A coedu- 
> college emphasizing agricul- 
її other applied arts, located 
ity. 
ty: A large coeducational 
in a midwestern city. 
private coeducational 
southern city. 
АР University: A coedu- 
ege, emphasizing agri- 
ш. зла other applied arts 
(nera city. 
University: A coeducational state 
stern city. 


Western State 
university located in a ме 


C. COLLECTION OF DATA 


A member of the College Board staff 
visited each of the participating institu- . 
with the exception of Western 
State University, for the purpose of 
making detailed arrangements for the 

a2 Prior to the visits, a 


collection of dat 
letter was written requesting that pre- 


liminary arrangements be made for se- 
lecting a supervisor to have charge of the 


data collection. 

2 Mr. Donald Peterson and the senior author 
of this report Were responsible for making these 
arrangements with the cooperating colleges. 

2qt is regretted that individual acknowledg- 


tions, 
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The original plan of the study called 
for the administration of achievement r 
tests in mathematics, physics, or chem” 
istry, where appropriate, for the purpose 
of supplementing regular course grades 
by objective examinations which could 
be used as additional criteria of 
success. Most colleges, however, 


academic 
were un- 
able to cooperate in this phase of the 
study. Arrangements: for administering 
achievement tests were made at only one 
institution. However, when the tests were 
actually administered and scored, it was 
found that the difficulty of the tests was 
not appropriate for the students; the re- 
sults were therefore not used 


in this 
study. 
1. Groups for Whom Data Were 
Obtained EN 
Three main types d И were 


planned: (a) comparisons Miran 
students who entered ip 


= ‘lof 1946 
with male nonveterans Wo шеге at 


the same time; (b) similar studies for stu- 
dents who entered in the fall of 1945; and 
(c) comparisons of male veterans whose 
college careers were interrupted by 
Service and who returned to 
the war with the best av. 
group. 

Collection of data on adequate num. 
bers of students who entered jn the fall 
of 1946 proved to be relatively straight- 
forward; similar efforts to obtain grou 
of adequate size among students entering 

d 


1N 1945 proved to be difficult because the 
nonveteran groups wer 


adequate in size, Asar 
the twenty-five grou 
was limited to stud 
the academic year 
other instances, stuc 


war 
college after 
ailable control 


1ps 


$ а 


1945-1946. In 


a few 
lents entering 


in the 


І У the decision 
anonymity of the colleges should 


ment in this report is precluded h 
that complete 
be maintained, 


fall of 1945 were pooled with rers 
entering in the fall of 1946 for т 
Ла the collection of data for the ade. 
Or veterans whose schooling was » me 
rup xl, the basic plan was to lim e 
po to veterans who had pas oH 
one year prior to interruption s 
year after interruption. For three mem 
this plan was followed. In two adc weve 
groups of interrupted veterans, i the 
it was found desirable to increase in 
flexibility of the defining pattern 
order to obtain larger groups. 
Logically, it would seem des 
use male nonveterans who had загі 
enced a similar interruption for а “ia 
son with the interrupted ee 
practice, however, it proved to һе 1 


irable tO 
1 expert 


sty inter 
sible to locate more than thirty group: 
4 s ne £ 
rupted nonveterans in any ot -hool 
e scho 


Consequently, nonveterans whos were 
ing was not interrupted, but pa in- 
otherwise as similar as possible r this 
terrupted veterans, were selected БИр? 
purpose. Thus, for three of the j^ I 
male nonveterans who entered а fu 
fall of 1945 and who completed t he 
academic years consecutively form i 
comparison group. For the vonage 
rupted groups including lisa жа 
a flexible pattern of interrupU jariso? 
uninterrupted nonveteran com enter 
Sroup was composed of students taken 
ing in the fall of 1939. Care was vas 

of course, to ensure that there ity 3 
reason to doubt the compara? ig 
grading standards before iin 
that the control group was suita 


nter 


ing 


2. Criterion Data „erage 
The criterion data included ү” i 
Brades, as determined by the СО or bY 
Which the student was enrollee е Ls 
calculation from data supplied specif? 
college. In addition, grades in SP“ cg 


nat! 
| A - mather 
Courses, such as English or ma 


3 
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were ai 1 
€ obtained in cases where the course 


had been taken by all or practically 
the students. | А 
жо гд of criterion data 
кален TAN and included in 
standing Prnt ir dem ойнар emir 
tion, М Pe: good standing, proba- 
health d Ша шыны) bene taithe 
jme 5, мач for psychiatric prob- 
"— E анепапв. Because of the very 
бее ыс (оп of students in these ex- 
акі а. however, and for other 
used in ipsas these data were not 

statistical analysis. 
: 3. Predictor Variables 
tei араа had originally been se- 
ability of on the basis of the avail- 
on some ae equate predictor dz Scores 
tude test nie. dis or scholastic apti- 
the eia ia available in all colleges; 
American pow test of this sort was the 
nation vb im Psychological Exami- 
Ure of b i E. In most cases, some meas: 
айва 1-school achievement was also 
grade "id such as high-school average 
dition NS in high-school class. In ad- 
high.scho, ral intelligence-test score and 
thought к д ade, other data which were 
of colle m ie potentially good predictors 
achiever achievement were included, 
admissions tests used by the college for 
Most emi or for sectioning being the 
composit ee example. In some colleges 
Brades hi di or predicted freshman 
inclugeq p^ available, and these were also 
Ca intere till other variables of theoreti- 
Were mure obtained, although they 
Ї Fries sa to be good predictors 
ables are fee Examples of such vari- 
апа date te of high-school graduation 
Ment ‘sie taking aptitude and achieve- 
Ability mig there was considerable vari- 
dents in Б these factors for veteran stu- 
certain institutions. 

Variety of methods of recording data 


were 
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used—hand-copying to rosters, 
photostats, microfilm, and punched cards 
depending upon such considerations as 
cost and the facilities available at the 
particular institution. 


D. AwaLvsis OF DATA 


The primary purpose of the analysis 
of academic data was to determine 
whether or not veteran students made 
higher grades, in relation to their abil- 
ity, than did nonveteran students. In 
order to obtain as precise a comparison 
as possible, it was considered essential to 
analyze data separately for each univer- 
sity, and, in institutions of complex or- 
ganization, separately for each college or 
division. Analyses were based on groups 
homogeneous with respect to institution 
eke division within that uni- 
Batch enrolled, and time of 
ege. Each such group in- 
cluded “feteran and nonveteran 
male studenti. A total of twenty-five sep- 
arate groups were defined by this process. 
'The groups within each institution are 
shown in Table 1. 

Colleges where differentiation into 
various divisions is delayed until after 
the freshman or sophomore ycar are 
classified as colleges of arts and science in 
this study. In all, 17 groups were from 
colleges of arts and science (so defined), 
4 were from engineering colleges, 2 from 
colleges of business, 1 from an agricul- 
tural college, and 6 groups involved in- 
terrupted veterans from arts and science 
and technological colleges. 


entrance, 


1. Preparation of the Academic Data 


In defining the specific students from 
each college to be included in the statis- 
tical analyses and in making the numer- 
ous detailed decisions required before 
analysis could begin, primary considera- 
tion was given to two objectives: (a) to 
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TABLE 1 
Tue TWENTY-FIVE GROUPS ™<LUDED IN THE STUDY, 


ARRANGED ACCORD 


D UNIVERSITY 


AN 


E 5 
Number of Case: 


БР Time of L N* 
University Division \ Entrance MV* M 

3 я 694 

Arts & Science Fall 1946 531 тїї 

A e Arts & Science Fall 19451 ae 166 
Central State Arts & Science Fall 1946 | E 185 59 
Central State Arts & Science Fall or Winter 1945 2 119 
Douglas Arts & Science Fall 1946 os 147 
Eastern City Arts & Science Fall 1946 23 99 
Eastern City Arts & Science Fall 19451 253 04 
Evans Arts & Science Fall 1946 id 146 
Harris Arts & Science Fall 1946 io 107 
Littletown State Arts & Science Fall 1946 ec 65 
—— Littletown State Business Fall 1946 He 98 
Middle State Engineering Fall 1946 33 72 
Midwest City Arts & Science Fall 1946 25 171 
Midwest City Engineering Fall 1946 a f 58 
Midwest State Business Fall 1946 Rm 102 
Midwest Technological Agriculture Fall 1946 14 106 
Midwest Technological Agriculture Fall 19391 И 128 
Midwest Technological Engineering Fall 1946 a 215 
Midwest Technological Engineering Fall тозоў мо 193 
Miller Arts & Science Fall 1946 : 425 50 
Southern Technological Engineering Fall 1945 or Fall 1946 229 348 
Stewart rts % Science Fall 1946 187 70 
Stewart J Science Fall 1945+ 55 101 
Taylor | '- wsgience Fall 1945 or Fall 1946 100 222 

Western?State 2 Science Fall 1946 433 
к= 


* Тһе abbreviations MV and p^ 
T The date given is for nonveterans; 
at various times and had their college 


bring into sharp focus any basic differ- 
ence in relative achievement between 
veteran and nonveteran students; 
(b) to provide data which would b 
comparable as possib 
chosen for analysis, 


and 
e as 
le for the 25 groups 


members of each of the 25 
necessary to balance 
obtained from a partici 
proportion of cases to be dro 


ively. 
"nd for male veteran and male nonveteran respec college 
The veterans with whom they are compared en 
careers interrupted by war service, 


ti 
desirabl ables 
ain vari 


the 


and second, it was necessary ог 
exclude students lacking data on cs fining 
(€g, first-year grades) as a means of de 
sample. 


les 
‹ "m amp 
2. Generalized Description of the $ 


„jous 
The students included in the -— 
Studies were male veteran stiati 
male nonveteran students who + Ў 
to one of the 25 groups chosen p ms of 
These groups were defined in t€ e cla 
the college or university, the ee a 
(€g, freshman in the fall of college ol 
the university division (e.g, C? n stu 
arts and science). In general, OM ебли 
dent included had earned а pecifie 
amount of college credit at а ata 
Periods of time, He had comple ti 
on all variables chosen for т 
analysis in his group. He had other 
tended, as a civilian student, апу 


stic* 
M. 
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ее or university; and in most groups, 
е had not received substantial credi 
(10 quarter hours) in specific courses v 
College work he had taken while irit 
c Services. In universities ing 
oes Hin, Be had been enro ed in 
fined guated. division during the entire 
dn period, which was typically one 
amen LM Except for the editing on 
‘ee armed-service college-training 
for Ls the procedures were uniform 
Ше оо and nonveterans. Typically, 
ы апа nonveterans were not 
until the editing was com- 
pleted, 
к p mim. of grades of vet- 
ча ом тойут (excepting only 
hie шый" groups) are thus 
Мав is E grades earned at the same 
E eg = the same university, and in the 
"Filis es within the university by 
Чень тон nonveteran students. Stu- 
sio ы тар done part of their aca- 
cluded Ex at another college are ex- 
чиир veteran students who had 
demic e college training in basic aca- 
fie subjects during their military 
Boreae: usually excluded from the 
isons, 


3. The Method of Analysis 


bs z first step in the actual analysis 
рте P ше the intercorrelations of 
€ach E and criterion variables.* For 
corel ЧР ‚ separate tables of inter- 

ons were computed for male 


4 
T 
quireg p tensive tabulations and analyses re- 
Partmen,. Tir study were executed by the De- 
ауага Ae Statistical Analysis, of which Dr. 
“nowledo; Tucker is director. Particular ac- 
rison, ier ae are also due to Mr. Harry Gar- 
Usiness ү was in charge of the International 
allagher Machines work, to Miss Henrietta 
to po Cr, who coordinated the analysis, and 


H Т: 1 
ing Seal ath Aronson, Head of the Comput- 


veterans and male nonveterans. For 
certain institutions (Midwest Tech, 
Middle State, Western State, Douglas, 
and Adams) a larger number of variables 
was studied than for the remaining in- 
stitutions. The more complete analyses 
were in general made in instances where 
they were justified by the size of the 
sample or by the availability of variables 
thought to be of particular interest. 
The basic design of this study required 
a comparison of the achievement of vet- 
erans and nonveterans after allowing for 
the effects of ability differences between 
the two groups. Since it was decided that 
the appropriate procedure for allowing 
for ability differences involved the use 
of regression equations, a more general 
approach to the comparison was followed. 
In effect «the question was raised: would 
session line (or plane) pro- 
ate description of achieve- 
ment ies tion to ability for .both 
groups? itis apparent that there are 
several ways in which the regression 
equations might differ. Thus, for a given 
set of predictors, grades of one group 
might be predicted more accurately than 
would be true of the other group. Again, 
the relative weights for obtaining best 
prediction might differ in the two groups. 
Finally, the constant terms in the two 
regression equations might be different. 
Each of these possible differences is 
meaningful For the purposes of this 
study, however, results are most readily 
interpreted if it turns out that the pre- 
dictors yield equally effective prediction 
(as measured by the standard error of 
estimate) and that the predictors may be 
assumed to have the same slopes in both 
groups. If these two conditions hold, the 
difference in constant terms of the re- 
gression equation provides a general 
measure of the difference between the 
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the per cent of veterans excelling the 
average nonveteran is always reported. 
Percentages of less than 50 then indicate 
superiority of the nonveteran subgroup. 
Percentages greater than 50 indicate 
superiority of the veteran subgroup. 

The criterion which was uniformly 
used in the analyses of covariance was 
freshman average grade, pointhour 
ratio, or some similar index based on 
course grades obtained during the fresh- 
man year. Grades in Specific courses were 

also used in a limited number of analysis 
of covariance studies. The predictors 
varied from school to school, but typi- 
cally two measures, combined through 
use of multiple correlation techniques, 
Were employed: a measure of high- 
school achievement, such as average 
grade or rank in class, and a test or 
composite of test scores. The most com- 
monly used test was the Ame “a /Coun- 
cil Psychological Ехатїпа - ‘cores on 


College Entrance Examination Board 
, and in 


65 a composite score 
based on various scholastic-aptitude and 
. achievement tests or tests of tool skills 
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was employed. єй 
2А slightly different approach was us c 
V ‘he case of interrupted veterans. Her 
it w\s assumed that the veteran’s fresh- 
man) jrades, earned before war — 
furnished the best possible qwe 
grades earned after discharge кыр ^ 
tary service. In the typical study € 
rupted veterans, therefore, the reg "s 
sions of second-semester pcs 
grades on first-term freshman grades Ж 
interrupted veterans and uninterrup se) 
nonveterans were compared. sen 
mester or quarter average grades fa an 
between the first term of the freshm re 
year and the last term of the none 
year were not used in the analysis. os 
term just prior to induction, it ы 
thought, might have suffered rane cal 
knowledge of the impending induc rm 
into the armed forces; and the Ns 
occurring immediately after the T pi- 
from service might not have been КА, 
cal, either because of need to read) o- 
to academic life or because of a peut 
тагу enthusiasm leading to overachi 
ment. 


IL RESULTS OF THE ANALYSIS 


In this section the results of the an” 
Ses of the academic data are pres d 
In discussing the results of comp 
ре ea groups studied, the fol- 
ee me will be followed: (a) stu- 
еце E» and science in private uni- 
in м ( ) students of arts and science 
аы p municipal universities; (c) 
ШШЕ E engineering in state and 
ewe m universities; (d) Students of 
‘tinted ў and of business in state and 
agua. universities; and (e) inter- 
и un and their uninterrupted 
e m. pigs groups. Within each 
cor ot main divisions, those groups 

nich the more extensive analyses 


Wer " a 
Bur done will generally be considered 


A. GRADES or VETERAN AND NONVETERAN 
STUDENTS IN ARTS AND SCIENCE 
COLLEGES OF PRIVATE 
UNIVERSITIES 


1. Adams University 


oo Ыйуегайу is a large private university 
quireq q ll candidates for admission are re- 
хатіпас present scores on College Entrance 
Yegarding t Board tests, along with evidence 
Por thee their secondary-school achievement. 
enterin 1946 group, about two-thirds of the 
A jas, oe had attended private schools. 
teshmen specific courses are not required of 
and all [ the selection of courses is limited, 
Courses ашап carry a uniform number of 
Study шй he group of students included in this 
Entered EY be defined as follows: students who 
1946 aem beginning freshmen in the fall of 
Uring tt who completed a full years work 
Ke Hir academic year YAGIT. 
M ae SE used in the comparison of 
Verbal and nonveterans at Adams were the 
Жайге Т Mathematical scores of the College 
tude Tes Examination Board Scholastic Apti- 
ear © ji (SAT). The criterion measure 15 ЖЇР 
сепа, ollege Average Grade. Grades are "per- 
ditions, grades based on a 100-point scale. Ad- 
Choo] арча studied were the Adjusted 
th ank, and a Predicted Grade, computed 
© university, which is based on adjusted 
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rank in school and College Board test scores. The 
adjustment of the rank in school is based on 
past records at Adams of students from each 
particular secondary school. The intercorrela- 
tions of the variables are shown in Table 2. 

“Date of Tests" was also studied in order to 
determine the relationship of amount of time 
elapsing between testing and college entrance to 
measures of achievement in college. Many of 
the veterans had taken the College Board test 
prior to war service, while practically all non- 
veterans took the tests in the spring just prior 
to entrance at Adams University. The mean date 
of testing for veterans was found to be between © 
1944 and 1945, with a standard deviation of 1.12 
years. It is apparent that there is sufficient varia- 
tion among the veterans to make the results of 
the analysis meaningful. 

The correlations involving year of testing are 
all low; they range from —.o8 to .21, The cor- 
relations with term averages are .03 and .o6. The 
highest correlation (.21) is with the Verbal score 
of the Scholastic Aptitude Test. This positive re- 
lationship might be accounted for in terms of 


higher standards for admission in the more 
recent y :Tiowever, such an hypothesis is not 
borne ou e correlations with the SAT- 


Mathemat/? score and the Adjusted School 
Rank, which are .og and .08 respectively. The 
slightly higher correlation with the SAT-Verbal 
score may merely reflect growth in vocabulary 
and other verbal abilities with age. By and 
large, it appears that date of taking the aptitude 
tests is a matter of little importance within the 
limits of age and time found in this study. This 
finding is of considerable significance in the in- 
terpretation of data in this investigation, since 
in most groups the veteran students were tested 
after war service, while nonveterans were tested 
soon after graduation from high school. 

The correlation of First-Semester Average 
Grade with Second-Semester Average Grade is 
Sı for each of the subgroups. This value may 
be considered as an indication of the reliability 
of semester grades, although it is presumably 
an underestimate. The reliability of average 
grade for the freshman year may be estimated 
at .go or higher, using the Spearman-Brown 
formula. 

"The veteran subgroup is seen to have obtained 
lower mean scores than the nonveteran sub- 
group on all the variables on which a comparison 
is possible. It is particularly interesting to note 
that the veterans were predicted to carn а mean 
average grade of about 72 and they actually 
earned a First-Semester Average Grade of 75.4, 
while the nonveterans were predicted to have a 
mean average grade of 74.8 and actually earned 
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INTERCORRELATIONS OF SCHO 
(For VETERANS Os 


AND FIRST-YEAR Corr 
Adams University, 


TABLE 2 


NI 


LASTIC APTITUDE Test Scores, D: 
LY) ADJUSTED $ {рог RANK, PREDICTED GRAI 


> Tests WERE TAKEN 


Ev. AVERAGE GRADES 
` 


College of Arts and M (ence, Freshmen, 1946-1947 


SAT-Verbal 


Date of Tests 


Male Veterans (N=531) 


a First-Semester Average of + 
smaller difference, 


It was found that the best si 


» and that the Adjusted 


School Rank was responsible 


slopes. The Breater slope of 


SAT-Methematical 


Adjusted School Rank 


Predicted Grade 


Male Nonveterans (N=69h ) 


ISAT-V 


75-7, à somewhat 


ngle predictor, for 
nonveterans, is the Predicted 


School Rank 


especially for non. 


the regressi 
grades on Adjusted School Ran oe 


increase in average grade for 
for veterans. One can о 
10 the nonintellectua] factors w 
high-school achievement and wl 
how been modified in veterans 
of military service. Since the 
test scores, used alone, did not ha 


: c nly speculate as to the 
reason for this finding; but perha 


ve significantly 


E 
п 
е 
al Ф 
A о to LI 
o ч @ 
о о g H 
- 3 h v 
o о о > 
Ф л <= 
Bf © 
©з 3 b 3 " 
228. E E! - "E. 
Jj 
B g = = E E] at 
[7] = = & al = Te 
7 E: .39 | 565 
-30 | 59} |80 


.60 | 76.2 | 7.0 
6.0 


ans, 
;eteran 

> туе! 
different slopes for veterans and ar e held 
they were chosen as the predictors е 


iterion is First 
the variables selected. The criterion is A 


ions 
College Average Grade. The correlation 


Instance are seen to be very similar for 
and nonveterans, The AME ay jc 
higher average scores for both е Р iuo. 
Mathematica] parts of the Scholae d е wa 
Test, and their Freshman AVES test SO), 
also slightly higher. Variability © s shown Bi 
Was slightly greater for veterans, а onveter o 
larger standard deviations, but the О евре© he 
Were slightly more variable pres tha AT 
average grades, Part II of Table 3 sh two 5 d: 
multiple correlations, based on the and n9 a 
Scores, are .48 and .46 for veles pups t 
veterans respectively, For both subg 47 г? 
bined, the multiple correlation is 47 ant я) 
terpreting these correlations, it is ime ection " 
remember that the tests were used in ШЇ jn at 
the Students; the resulting curtailme 


уе! 


ыл 
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C TABLE 3 
Омр; š 
PARISON OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 
nd Science, Freshmen, 1946-1947 


10ns: 


е Adams University, College of А) 
. Correlations, Means, and Standard D 


Correlation with: 
Variable Sub- -Yi ) 
group SAT- SAT- qe Y A Mean, SD N 
Verbal Math. | Grade 
1- Scholastic Apti 
nola ptitude MV 23 41] 536 93 531 
est-Verbal MN +17 -391 565 86 боз 
2. Scholastic Apti 
astic Aptitude MV E . 6 8 5 
Test-Mathematical MN e "30 Sos 89 боз 
3. First-Year е 
? ollege MV 41 +33 Fie 6.1 
verage Grade MN +39 +30 73.8 6.4 B54 
IL. Mult; т 
Iultiple Correlations (Variables т and 2 vs. Variable 3): for MV, .48; for MN, .46; and for the 


combined 
II ned group, .47. 
nalysis of Covariance Results: 


. Chi- Degrees Probability that a value 
Hypothesis ced of greater than obtained 
quare Freedom would arise by chance 
A. Equality of errors of estimate 2.008 I Between .10 and .20 
. Бача of slopes „733 Between .50 and .7о 
“quality of intercepts 1.213 Between .20 and .30 


Iv, р; 
Difference between Subgroups with Ability Held Constant: 


Male Veteran 
0.36 
0.06 
52 
Not significant 


Superior subgroup 

dvantage expressed in grade units 
Advantage expressed in standard error of estimate units 
Per cent of veterans excelling the average nonveteran 
Level of significance of difference (from IIIC above) 


veteran students’ advantage is the percentage 


abilit 
eterans found to exceed the average non- 


the M ОЁ test scores has presumably lowered 


luc gt to some extent. а ‹ е average поп 
the three of the table presents the results of veteran in grades adjusted for ability differences; 
Covariance significance tests in the analysis of in the case of Adams, this turns out to be only 
slopes M Differences in errors of estimate and 52. If there were no difference, thiis percentage 
regression not significant. The intercepts of the would of course be 50. The difference, as noted 
Шеге planes, also, are not significantly above, is too small to be statistically significant. 

Scores) is when ability (as measured by SAT 
Y vetera made equivalent, the grades carned 

‘ans and nonveterans are too similar to 


Warr; 

ant the i i i 
Pi conc! grou 1S 
Superior, lusion that either group 


of v 


2. Stewart University 


For the Stewart University students entering as 
freshmen in 1946, the analysis design was much 
like that for Adams. At Stewart, intercorrela- 


P 
Sus 0 of the table highlights the findings: 
NOnveter: erang have a slight advantage over 
°Xpressed p of equivalent ability; the advantage, 
+36, On an Adams University grade units, is 
of th erms of the mean grades shown in Part 
of. € table, the nonveterans have an advantage 
in Foon advantage of the veterans, expressed 
Perha ard error of estimate units, is only .06. 
Ps the most meaningful measure of the 


tions among College Board Scholastic Aptitude 
Test scores, Adjusted School Rank, date of 
taking admissions tests, and First-Year College 
Average Grades were obtained. In comparing the 
relative achievement of veteran and nonveteran 
male students, allowance was made for three 
Scholastic Aptitude — Test-Verbal, 


predictors: 
Aptitude Test-Mathematical, and 


Scholastic 


14 


Adjusted School Rank. co а 
Stewart is a private institution for men, simi- 
lar in many respects to Adams University. Stu- 
dents are required to present College Board 
scores, along with their secondary-school records, 
for admission. As at Adams, the majority (about 
three-fourths) of the 1946 entering students had 
attended private schools. As freshmen, Stewart 
students select their program within a restricted 
framework. The group of entering freshmen may 
be defined as follows: students who entered as 
beginning freshmen in the fall of 1946 and who 
completed a full year's work during the academic 
year 1946-1947. Since all students carry a fixed 
number of courses, it was not necessary to con- 
sider variations in academic load in defining the 
D sample. 
~The statistical results involved in the com- 
parison of achievement of veteran and nonvet- 
eran students are presented in Table 4. The 


Comparison 


Stewart University, 
EIE Correlations, Means, and Stan 
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predictors again included the College A 
SAT scores, both Verbal and Ó— Em 
Fheir predictive value was very та also 
as at Adams. Adjusted School Rank wa a 
use ^at Stewart, and its predictive че ы 
high\\y = 53 for veterans and .62 ion р all 
erans) {Тһе multiple correlations (basen M 
three predictors) were higher than for н 
because of the inclusion of the measure e eri 
school achievement. As at Adams, the nor al 
students on the average had higher Же Aver- 
the predictors and also a higher First-Yea ade 
age Grade. The actual difference in Өй ne 
is .g1 on the grading system used at mantle 
Stewart uses a seven-step grading SE value 
analysis, the highest grade was given ed 
7, the next 6, and so on, 1 being the eae that 
The analysis of. covariance results ~ 
the hypotheses of equal errors of oan 
equal slopes of regression planes are 


e an 
dis- 


TABLE 4 
OF AVERAGE GRADES EARNED py VETERAN 


; ENTS 
AND NoxNvETERAN MALE STUDEN 


College of Arts and Science, Freshmen, I046-1047 
dard Deviations: 


Correlation with: N 
: Sub--[ 77 Р 5р 
Variable / F, Adj. 1st-Yr. | Mean 
SrO ж Wan B School | Average 
Weste athe | Rank | Grade ES 
ү 187 
1. Scholastic Aptitude MV £ 86 8 
Test-Verbal MN = ai ed = 82 й 
е 87 
2. Scholastic Aptitude MV i 77 24 
Test-Mathematical | MN | “2p о ае AES NE. 
ё 87 
з. Adjusted School му | 4 s| x5 5 
Rank MN. ЖҮ 3 Hral 15 ge 
ү У 87 
4. First-Year College MV А | 348 
Average Grade MN Ad p ne и 183 | 34 
t 
I. Multi ati : = send lon 
1 шк рч (Variables т, 2, and 3 vs, Variable 4): for MV, .60; for MN, .66; a? 
III. Analysis of Covariance Results: 
]ue 
А ility that a уа 
Hypothesis Chi- D к шз p obtained 
ч а 
UE Freedom would arise by € 
' А. Equality of errors of estimate and -95 
B. Equality of slopes ree t Bevera р and -50 
С. Equality of intercepts 2. B 9 Bebe ‘yo and +? 


IV. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 
Advantage expressed in grade units 
Advantage expressed in standard error 
Per cent of veterans excel 

Level of significance of di 


Male Vetera? 
0.09 
о.14 


56. 
Not significant 
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" TABLE 5 
MPA а 
{PARISON OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 
n. | Douglas University, College of fats and Science, Freshmen, 1946-1947 
- Correlations, Means, and Standard Рей їопѕ 
| 'orrelation with: 
Variable S 
ub- H: S: 1st-Yr. Mean SD Г 
group ACPE | Average | Average ^ 
) Grade Grade 
1. ACPE Total 
а MV E +35 6 
н (raw score) . MN P ЕЕ ы E x í 
2. Hi 
High-School MV ET .52 3.26 2.0 
erage Grade MN .32 -65 4.07 2.36 d 
3. First-Year С, 
ar College MV s 
E Average Grade MN 33 ds | "e Ed ES 


ДТ. A 
Multiple Correlations (Variables т and 2 vs. 


UL. combined gn UP, .71. 


Variable 3): for MV, .59; for MN, .74; and for the 


nalysis of Covariance Results: 
E s n Degrees Probability that a value 
Hypothesis ws of greater than obtained 
Freedom would arise by chance 
А. i i : 
i Equality of errors of estimate | 0.0506 I Between .80 and .90 
Bo ity of slopes 2.048 2 Between .30 and .50 
quality of intercepts | 0.0587 Ф f Between .80 and .90 


IV. pi 
ifference between Subgroups with Ability Held Constant: 


Superior subgroup 
dvantage expressed in grade units 


dvantage expressed in standard error of estimate units 
sd cent of veterans excelling the average nonveteran 
evel of significance of difference (from ПІС above) 


Male Veteran 
0.02 
0.04 


52 
Not significant 


Proy 

сасе difference between veteran and 
Sion Biter tee in intercepts of their regres- 
*Xectanc а well. within the range of chance 
again EAS he advantage of the veteran is 
18 taken or din to be significant when account 

| In additi ifferences in ability. 
11 the anal оп to the variables directly involved 
the sian a of covariance, attention was given 
Were take T during which College Board tests 
Similar eh results for this variable were 
cally aj ti ose found at Adams. While practi- 
1946, the a nonveteran students were tested in 
idway pec ean date of testing for veterans was 
€Viation apc 1944 and 1945, with a standard 
testing оне year: The correlations of year 
(With n other variables ranged from .10 
SAT. 215984 School Rank) to —.04 (with 
Telation nd First-Year Average Grade). The cor- 
tim, ge SAT-V was .07 at Stewart. The 
esting was.again found to be a factor 


negligi а 
Of ае importance within the conditions 


3. Douglas University 


Douglas is the first of many groups for which 
American Council Psychological Examination 
scores were available. It is the only liberal arts 
group for which the relation of year of high- 
school graduation to the other variables was 
studied. 

Douglas University is a coeducational private 
university located in a southern city. Admission 
to Douglas depends primarily upon the student's 
secondary-school record. In the 1946 group, 
about 45 per cent had attended private schools. 
Certain required courses are set up for freshmen 
in arts and science, required subjects being 
English, mathematics, and social science. The 
group studied at Douglas met the following re- 

uirements: all entered as beginning freshmen in 
the fall of 1946 and completed three full quarters 
during the academic year 1946-1947- 

The predictors used in the comparison of 
veterans and nonveterans at Douglas were total 


16 FREDERIKSEN 


score on the ACE Psychological Examination 
and High-School Average Grade. The high- 
school grade, which was expressed in letters, 
was converted into numerical form as follows: 
А =8, A-=7, B+ —6, B=5, B— — 4, etc. 
The criterion measure is First-Year College 
Average Grade. Grades were based on a four- 
category scale, the units of which had numerical 
values of 3 to o. я 

In addition to the variables included in the 
analysis of covariance, year of high-school gradu- 
ation was studied for male veterans only. The 
average veteran in this group was graduated 
from high school in 1944; there was considerable 
variability as indicated by a standard deviation 
of 1.7 years. The correlation of year of gradua- 
tion with ACPE total score was —.06; with High- 
School Average Grade, it was —.18; and with 
First-Year College Average Grade, it was —.28. 
Thus there was a slight tendency for the veterans 
who had been out of school longer to have higher 
grades both in high school and college. 
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The results of the analysis of a emere 
shown in Table 5. The American we oi 
chological Examination total score ап ists: 
5. *ol Average Grade were chosen as prec s p 
ultiple correlations were found to л. 
* for veterans and nonveterans respec igher 
and À} for both subgroups combined. phe s 
validities for nonveterans is undoubtedly 
in part to their greater va ability. jopes of 

Differences in errors of estimate and $ SE ROTER 
the regression planes were found to be epos dif- 
than would be expected by chance, anc lanes 
ference in intercepts of the regression, Ваке 
was also not significant. When account 15 bility, 
of differences between the subgroups in @ 


e 
: n] erage gta 
the mean difference in freshman aver m “com: 


f the 


pared with a difference of .26 +. made: 
nonveterans) when no SED F 
standard error of estimate units, the exce 
is of; 52 per cent of the veterans € 
average nonveteran. 


TABLE 6 1s 
EN 
Comparison or AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDE 
Harris University, College of Arts and Science, Freshmen, 1946-1947 


I. Correlations, Means, and Standard Deviations: 


= 
£ af Correlation with: 
: Sub- ` £ N 
Variable 2 Com- 1st-Yr. Mean SD 
group posite H. S. Avera 
Te Rank Be 
Test Grade 
1. Composite Test MV .46 55 164 28 a 
| MN -54 152 175 32 ; 
2. High-School Rank MV Ка a 
(сомен всоге) MN 2 59 B 1 d i: 
А ` i 5 
3. First-Year College MV 7° 14 
Average Grade MN E “2 ud Е Т 140 
65 Я 
the 
П. Multiple Correlations (Vari zm ; and for 
combined group, бз, (Variables т and 2 vs, Variable 3): for MV, .61; for MN, .68; а" 
III. Analysis of Covariance Results: 
]u 
m са уа 
Hypothesis Chi- Degrees Probability thes tained 
square of greater t! by chance 
Freedom would arise by 
A. Equality of errors of estimat and -5° 
B. Equality of slopes SS о Фол T Teorem gs га :20 
С. Equality of intercepts 6:6 1 Бет ЕЕ and -5° 
IV. Difference between Subgroups with Ability Held Constant: 
Superior subgroup Я Jale Vetera? 
Advantage expressed in grade units me 
vantage expressed in standard : ; 11 
Per cent of veterans excelling ‘the ачаг оГ timate units ў 


Level of significance of difference 


average nony 


(from IIIC above) 


4. 
eteran Not significant 


WU 


4. Harris University 


The analysis of data for students in На 
University was limited to that necessary 
comparison of relative achievement of v 
шеш students after allowing i 
ids ces in high-school standing and a composite 

re. based on five entrance tests. 
E us ч а coeducational private midwestern 
tia ge o arts and science which is bound by 
a s of tradition to one of the major religious 
шыш ш: Наггїз students are drawn from 
duse half of their high-school graduating 

asses, Freshmen choose their own program 
En a series of general requirements, only 
at ow being specifically required. For study 
nists s e ee the following group of 
beriani, was selected: students who entered as 
ШЕ ne freshmen in the fall of 1946 and who 
th р eted substantially a full year's work during 

е academic year 1946-1947- 

The predictors used at Harris included High- 
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School Rank and a Composite Test score. (High- 
School Rank was converted to a standard-score 
scale having a mean of 13 and a standard devia- 
tion of 4.) The composite score, which is com- 
puted routinely at Harris, is based on the 
‘American Council Psychological Examination 
(1942 edition) and four Form T Cooperative 
tests: the Cooperative English "Test and the three 
Cooperative General Achievement Tests in social 
studies, natural sciences, and mathematics, The 
composite score was obtained by adding to the 
ACPE total score twice the sum of the scaled 
scores on the four achievement tests, after both 
the ACPE total and the sum of the scaled scores 
had been converted to standard scores based on 
local norms. The criterion as usual is the First- 
Year College Average Grade. A six-step grading © 
system is used at Harris; in this analysis, the 
numerical equivalents of the steps were 3, 2, 1, 
о, —1, and —2. 
The results of the analysis are shown in Table 
6. The nonveterans at Harris proved to be 


TABLE 7 
VETERAN AND NONVETERAN 


MaLE STUDENTS 


Freshmen, 1946-1947 


E Correlations, Means, and Standard Deviations: 


aA 


; Correlation wit 

Variable Sub- 1st-Yr. Mean SD N 

: grouP | ACPE H.S. | Average 

Rank Grade 
1. ACPE (1946) Total MV .26 E III 20 425 
raw score) MN «32 .39 112 20 193 
?. High-School Rank MV .26 -43 ns 3.3 "425 
(converted score) MN 32 .58 15- 3-4 193 
3. First-Year С 1.49 -56 | 425 

аг College MV 41 +43 
Average Grade MN .39 .58 1.50 -64 | 193 
.53; for MN, .62; and for the 


It. Multiple Correlations (Variables x and 2 v 


s. Variable 3): for MV, 


u Combined group, .56. 
I. Analysis of-Covariance Results: 
i Degrees Probability that a value 
H " Chi- E greater than obtained 
ypothesis square Freedom would arise by chance 
А. Equality of errors of estimate 1.136 Е Вери: i ап ES 
: equality of slopes dg т Between .20 and .30 


- Equality of intercepts 


Iv, p; Hi 
+ Difference between Subgroups with Ability Н 


eld Constant: 


Superior subgroup " 
dvantage expressed in grade units 
| Advantage expressed in standard error o 
Per cent of veterans excelling the averag 
Level of significance of difference (from I 


f estimate units 
e nonveteran 


ПС above) 


Male Veteran 
0.07 
о.14 
56 
Not significant 
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TABLE 8 е 


x i MEAN { MALE STUDENTS 
Comparison OF AVERAGE GRADES EARNED By V ETERAN AND NONVETERAN MaLE S 


Evans University, College of Arts an "Science, Freshmen, 1946-1947 
I. Correlations, Means, and Standard Deviations: 


` 


3 Be 
Correlation wit 


N 
Variable Sub- ist-Yr. Mean SD 
Егор АСРЕ Average 
Grade 
283 
ACPE Total MV 5 12.0 3.3 94 
(converted score) MN 5 13.1 3-1 
283 
First-Year College MV 45% 2.10 ‚бт 94 
Average Grade MN .45 2.05 ‚бо 
Validity coefficient for combined group: -49 
II. Analysis of Covariance Results: 
н s ]ue 
Chi Degrees Probability Шара 
Hypothesis ө < of greater than О shance 
Эа Freedom would arise by С 
o 
A. Equality of errors of estimate 0.0285 Between .80 end “Bo 
B. Equality of slopes 0.148 1 Between .70 an B 
C. Equality of intercepts 5.504 1 Between .ог anc - 


III. Difference between Subgroups wA Ability Held Constant: 


Superior su bgroup 


dvantage expressed in grade units 
Advantage expressed in standarı 
Per cent of veterans excelling t| 
Level of significance of differenc 


part to the greater vari 
this measure, 

The analy: 
the hypotheses of ei 


5. Miller University 


As at Harris, the anal 
data at Miller was limi 
for comparing the relative achieve 


n subgroup is 


Р means and standard deviations, the, 
ysis’ of the academic і 
ted to that Tequired 


ment of male 
veteran and nonveteran students. The pre- 


Male Veteran 


о›1$_ 

d error of estimate units 0.28 
he average nonveteran ox % 
e (from ПС аһоуе) ee 


М Со 
dictors employed were the Amen s High 
Psychological Examination total score 2 саг COF 
School Rank. The criterion was First- 

lege Average Grade. 

Miller is a large coeducational 
versity located in an eastern city. A 
the College of Arts and Science аге 
drawn from the upper three-fifths O 
ing classes of accredited high E 
course required of all freshmen E s 
usual, however, the formulation of pu er M 
Program is determined in part by study B 
quirements. The group selected y o entere 
be defined as follows: students b 1946 Ww. 
as beginning freshmen in the fall A (ele 
who completed a full year SEs aca 
more hours each semester) during th millet 
year 1946-1947. NM. 

onis of ‘the analysis of data oe reting 
students are shown in Table 7. In i following 

get 
information may be useful: The gne un 
at Miller is based on a five-step ics range Пу 
merical equivalents of the categories tical 2 x 
3 through o to —1, For use in statis 


u 
rivate UP 
ийет " 
typical 
jaduat- 


The only 


ven |, 
demie 
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sis, High-School Rank was converted to a 
Standard scale having a mean of 13 and a stand- 
ard deviation of 4. 
ссе мешн tend to excel nonveteran 
of T equivalent ability. Fifty-six рег 
Miete yoran subgroup exceed the aryrage 
The ait but the difference is not signidcant. 
Май м. аге in slopes of the regression planes, 
ӨЕ, casts some doubt on the accuracy of 

evaluation of the difference in intercepts. 


6. Evans University 


ud students entering Evans University as 
uem a the comparison of achievement be- 
Чыйт: каем апа nonveterans was carried out 
the Sin n y а single А predictor—total score | on 
Hone пегісап Council Psychological Examina- 
Gritertor a basis for equating aptitude. The 
age iu usual, was First-Year College Aver- 
Church. €. Evans is a coeducational, private, 
hci Ree college of arts and _ Science 
typically a midwestern city. Admission is based 

у upon the high-school record of the 


student. At Evans, English is a required sub- 
ject; the remaining requirements in the fresh- 
man program allow some choice of subjects. 
The group chosen for analysis at Evans was 
limited to students entering as beginning fresh- 
men in the fall of 1946 who completed two se- 
mesters of eleven or more hours each during 
the academic year 1946-1947. 

The results of the analysis are shown in 
Table 8. The percentage of veterans exceeding 
the average nonveteran was found to be 61; 
this advantage of the veterans is significant 
at the 2 per cent level. 


7. Turner University 


At least two special features characterize the 
analysis of data for freshmen at Turner Uni- 
versity: first, the average grades are based on 
achievement-test scores used by the college 
rather than on the course grades; and second, 
students entering in the fall of 1945 have been 
combined with those entering in the fall of 
1946 in making up the group. The inclusion 


TABLE 9 
Comparison or AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MaLE STUDENTS 
Turner University, College of Arts e Science 


1 (Students who entered as freshmen in fall, 
Correlations, Means, and Standard Deviations: 


буо г fall, 1946) 


= 


Correlation with: 


Variable Suh- 3 ist-Yr. Mean SD N 
group Composite Average 
Test Grade 
Composite Test MV .61 66.3 7.3 100 
converted score) MN ‚бо 68.1 8.0 тот 
First. Y 
= Year College MV .бї 2.47 .66 тоо 
Average Grade MN `бо 2.73 Sr zer 
MER 
alidity Coefficient for combined group: 
It, е 
Analysis of Covariance Results: 
a Degrees Probability that a value 
H hesi Chi- of greater Гап obtained 
чина square Freedom would arise by chance 
T Equality of errors of estimate 4.5403 т Boyen +02 Pu +05 
С Equality of slopes 0.2406 I Бес .5о md +70 
+ Equality of intercepts 3.7527 т etween .o5 and ‚то 


И, ту 
: Difference between Subgroups with Ability Held Constant: 


Superior subgroup А 
vantage expressed in grade units 

dvantage expressed in standard error o 

ег cent of veterans excelling the a 


f estimate units 
verage nonveteran 


€vel of significance of difference (from IIC above) 


Male Nonveteran 
^ o.16 
0.28 


39 
Not significant 
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school course of study. As usual, freshmen in 
arts and science found that their program per- 
mitted a number of alternative ways of meet- 
ing various requirements; only English was a 
required course. For the larger group at Central 
State, the following definition may be stated: 
male students-who entered as freshmen in the 
fall of 1946 and who completed two semesters 
of academic work during the academic year 
1946-1947. 

The following information may be useful in 
interpreting the results presented in Table 11. 
The Composite Test score was reported as a 
percentile rank based on six tests: Correctness 
and Effectiveness of Expression, Reading Ma- 
terials in Social Studies, Reading Materials in 
\ Natural Science, Interpretation of Literary Ma- 

terials, General Mathematical Ability, and Gen- 

eral Vocabulary. The percentile scores were 
converted to a standard scale with a mean of 

13 and a standard deviation of 4. The criterion 
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was the First-Year College Average Grade. T 
grading system used five categories having 
numerical values 4 to o. , 
Ne results fos students entering in ce 
of \\46 are presented in Table 11. It RENÉ 
noted\that the Composite Test has а S nell 
highe* validity for veterans than tor SHOE 
erans, and that the validity of pigras i 
Average is the same for both subgroup үө 
most institutions it has been found college 
school standing is more predictive 2 s. Sixty- 
grades for nonveterans than for Meee the 
five per cent of the male veterans difference 
average nonveteran, the most extreme freshman 
so far encountered. The difference in ir highly 
grades, when aptitude is considered, is 
significant, 

The group of students which enter! 
may be defined as follows: male stuc 
entered in the fall or winter semester E. 
and who completed at least three $ 


3 5 
ed in 1945 
lents who 
of 1945, 
mesters 


TABLE її 


COMPARISON ОЕ AVERAGE GRADES EARNED BY VETERAN 
Central State University, College of Arts and Science, 


I. Correlations, Means, and Standard Deviations 


DENTS 
AND NoNvETERAN MALE STUD 


Freshmen, 1946-1947 


— 
— 2 
wf Correlation with: N 
Variable sup | Cem | HS | atv. | Men | SD 
posite Avg. Average 
Test Grade Grade "Ww 
1. Composite Tést MV > Ы 4 
(converted score) MN E 5 is 2 3 
E 55 А 
" 66 
2. High-School MV 6i 
Average Grade MN ae A e: Э - 164 166 
H d 3 66 
3. First-Year College MV 68 H 
Average Grade MN d аг 5d 16 166 n 
A he 
П. Multiple Correlati i z апа for f 
combined group, 68. Variables 1 and 2 vs, Variable з): for MV, .69; for MN, .675 ап 
III. Analysis of Covariance Results: б 
G * A yalue 
Hypothesis Chi. | Degrees | Probability ерлей 
square - of greater ti b chance 
Freedom would arise by 
A. Equality of errors of esti 4.00 
B. Equality of slopes pu e Rud t Between oe i eg 
. Equality of intercepts nee т fon m -or 


IV. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 
dvantage expressed in 
dvantage expressed ir 
Per cent of veterans exce 
Level of significance of di 


grade units 


L 


ff 


1 standard error of estimate units 
lling the average nonveteran 
erence (from ПІС above) 


Male Vetera? 
0.19 
0.39 


65 
1% 
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TABLE 12 
COMPARISON OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 
Central State Un ‚„ College of Arts and Science 
(Students entering as (тезї Ду uring the academic year 1945-1946) 
I Correlations, Means, and Standard банов: 
[ Correlation with: 
Variable Sub Com- ist. 3 Sem. Mean SD N 
group posite Average 
Test Grade 
Composite T 
te Test MV 43 13-5 р 
è s 3.8 т 
| (converted score) MN 49 14.5 4.2 z 
| Fi ч 
irst Three Semesters 
5 МУ „4% 2.36 385 135 
ollege Average Grade MN -49 2.38 -65 29 © 
Validity coefficient for combined group: „45 
П. Analysis of Covariance Results: 
EC. Chi- Degrees Probability that a value 
Hypothesis sieh of greater than obtained 
q Freedom would arise by chance 
2 Equality of errors of estimate 2.792 1 Between .o5 and .10 
| C Equality of slopes 0.795 I Between .30 and .$о 
- Equality of intercepts 0.313 a Between .50 and .70 


I ; ы 
п. Difference between Subgroups with Ability Held Constat A? 


Superior subgroup 


Advantage expressed in grade units 


Level of significance of difference 


Advantage expressed in standard error of estimate units 


t Per cent of veterans excelling the average nonveteran 
(from ПС above) 


Male Veteran 
0.04 
0.09 


‚54. 
Not significant 


ү the summer of 1947. An eight-week sum- 

Of th erm was counted as one semester for three 

The 135 veterans. | | 

1945 UMS plan for the group entering In 

only Т, ered from that for the 1946 group !n 

све ee respects: First Three-Semesters Col- 

and Hee Grade was used as the criterion, 

the а igh-School Average was not included in 

$ 8 eh of covariance. Basic results are 

rather in Table 12. The number of cases 15 

mu small for the 1945 group; the results 
therefore be interpreted with caution. 

BC. validity coefficients for the Composite 

Ev oie were .43 and .49 for veterans and 

Neh crans respectively. Those for High-School 

two ET turned out to be .33 and .65 for the 

tors ubgroups. Since the use of both predic- 

fellate wee regression planes which differed 

ван, in slope (at the 2 per cent level of 

om ance) it was decided to use only the 

1g ib Osite Test as the predictor. From Table 

May be seen that 54 per cent of the vet- 


erans exceed the average nonveteran in average 
grade. 


3. Littletown State University 


Two groups, both entering as freshmen in 
the fall of 1946, were studied at Littletown 
State, Of these, the group entering the Col- 
lege of Arts and Science will be discussed in 
this section; the other group, which entered 
the College of Business, will be discussed in a 
later section. For the arts and science students, 
the analysis was limited to a comparison of the 
achievement of veteran and nonveteran stu- 
dents after allowing for differences in Ameri- 
can Council Psychological Examination total 
scores. 

Littletown State University is a coeduca- 
tional state university located in a small mid- 
western city. Students are drawn mainly from 
the high schools of the state, and are admitted 
on the basis of high-school graduation, Stu- 
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TABLE :3 — 
if 'U {ОХУ E "d ALE STUDEN 
Comparison OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE 


Littletown State University, College of Art 
1. Correlations, Means, and Standard Deviations: 


id Science, Freshmen, 1946-1047 


Correlation with? 


Sub- 


{ SD 
iabl ist-Yr. Mean 
UMS group ACPE Average 
Grade 
103 
ACPE Total MV -49 тїї 36 107 
(raw score) MN Pe 115 2 
103 
First-Year College MV -49 2.29 . i 107 
Average Grade MN -34 2.35 . 
Validity coefficient for combined group: +42 
II. Analysis of Covariance Results: - 
m alue 
Chi- Degrees Probability oe е 
Hypothesis square of greater than ob Ree 
Freedom would arise by chá 
л .50 
А, Equality of errors of estimate о.814 І Between . 30 азе do 
. Equality of slopes 0.464 Between -30a e 
C. Equality of intercepts 0.00193 1 Between .95 аг 


III. Difference between Subgroups Ау Held Constant: 
7. 


* veterans excelling the ave, 
evel of significance of difference (fro; 


dents with Poor averages in high school are 
admitted on a Probationary basis, Freshmen in 
arts and science are required to take 

course; the remainder of thei 
termined by broader requi 
under consideration ma 
students who entered as 
the fall of 1946 and w 


demic year, 1946-1947. The criterion, First-Year 
College Average Grade 


hour ratio, based on a 
the numerical values о! 
the ACPE were used, 
The results are shown in Table 
allowance is made for 
average grades of vetera 
Littletown State are almost identical 


course, the very slight difference in favor of 
nonveterans is not significant, 


4. Eastern City University 
For students entering Eastern City in the 
fall of 1946, the analysis was limited to a com- 


" 

Male Nonvetera! 
0,00 
0.01 


$9. 
Not significant 


n stu- 


Я ега ГА 
Parison of male veteran and nonveter арр 


dents, after allowing for differences 1° 
tude reflected in High-School Average 
and Composite Score on entrance tests. 
terion measure was First-Year College 
Grade. 


Eastern City 


he cri- 
Average 


aa 
ipa 
i unic 
is a coeducational m s 


А larg 

a 
college of arts and science located a сиу 9? 
city. Students are admitted to Easter eir nigh- 


а competitive basis, using primarily E 
school records and their scores on po^ 
aminations administered by the c9 ris and 
though the freshman program ae en 
science is not prescribed, a relatively 
ber of required courses, in Englis a 
matics, and social sciences, must be C | 
before graduation, og analys 

The Broups selected for инса! Do) E 
may be described as follows: male S ME 0 
enrolled as beginning freshmen in oe of act 
1946 and who completed two semeste roup 
demic work, The limitation of the Seduced 
Students entering in the fall greatly ау, sinc 
the number of veterans available for uan * 
many veterans had been admitted 


num- 
mathe 
mpletes 


— C IÜ 
Mp 


NES |l 
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ё ТАВІЕ 14 
ОМРА { — a 7 Ф 
ARISON OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 


I. Correlations, Means, and Standard Dex, 


Eastern City University, a Dag one: and Science, Freshmen, 1946-1047 


105: 


Correlation with: 


Variable Sub- Composi 
г posite 1st-Yr. Mean SD N 
BERG Тезї-ЕН. S. Average d А 
Average Grade 
Composi 
Posite Test Score MV | 
Н MV 165.5 s 53 
plus High-School Average | MN 2 167.5 E | a 
First-Y, > 
- Year College MV z | 
verage Gradc а 45 0.26 53 33 
= g rade MN .54 о.37 | | uy 
А]; "Ж" = 
alidity coefficient for combined group: 53 
Th. ; 
Analysis of Covariance Results: 
А Chi- Degrees Probability that a value 
Hypothesis sdü&re of greater than obtained 
que Freedom would arise by chance 
А. Equality of errors of estimate 0.128 I Between .7o and .So 
pauahty of slopes 0.0184 I Between .80 and .9о 
» Equality of intercepts 0.0414 I Between .8о and .9о 


HI. Di 
Difference between Subgroups with Ability Held Constan 


Superior subgroup 
Advantage expressed in grade units 


Advantage expressed in standard error of estimate units 
er cent of veterans excelling the average nonveteran 
Level of significance of difference (from ПС above) 


Male Nonveteran 
0.02 


4 
Not significant 


ioa ur Spring. It was considered desirable, 
Obtain as to exclude these veterans in order to 
tween vet comparable conditions as possible be- 
For пы най nonveteran students. | 
аде апа setae analysis, High-School Aver- 
Using e omposite Test score were combined, 
were va weights. (The standard deviations 
Was Бам Шу equal.) The Composite Test score 
tive teat on performance on сїрїї Coopera- 
Dess of ix Mechanics of Expression, Elfective- 
Prehensi Xpression, Vocabulary, Speed of Com- 
matices pa Level of Comprehension, Mathe- 
results paral Science, and Social Studies. The 
m Phe the analysis are presented in Table 
e RHA por cent of the veterans exceed 
apping P nonveteran; the amount of over- 
ШШЕ. the distributions is very great, and, 
, the difference is not significant. 


5. Midwest City University 


M ge Broups, both entering as freshmen 
Section ете studied at Midwest City. The present 
the с, is concerned only with those entering 
' College of Arts and Science. For Midwest 


it eae 
У students, the analysis was limited to а 


in 


comparison of the relative achievement of male 
veteran and nonveteran students after eliminat- 
ing the effect of differences in performance on 
the American Council Psychological Examina- 
tion. 

Midwest City is a large coeducational munic- 
ipally supported institution. Students are ad- 
mitted on the basis primarily of high-school 
record, being selected from students graduated 
in the upper two-thirds of their graduating 
classes. Freshmen in arts and science are re- 
quired to take English and a survey course in 
western civilization and to fulfill additional 
broader requirements. The group studied may 
be defined as follows: students who entered as 
beginning freshmen in the fall of 1946 and who 
completed seven ог more semester hours of 
academic work during each semester. 

Total raw scores on the ACPE were used as 
the only predictor for this group. The criterion, 
the First-Year College Average Grade, is based 
on a scale of six points corresponding to the 
values 5 to о. The results of the analysis are 
shown in Table 15- 

An unusually large difference between the 
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TABLE 15 а 
7 v AND NONVETERAN MALE STUDE? 
COMPARISON OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MA 


Midwest City University, College of Arts 
I. Correlations, Means, and Standard Deviations: 


d Science, Freshmen, 19046-1947 


———— 

Correlation with: | | , 

S 3 
pe m 
Variable Sub- | бїз | Mean SD ү 
ётрир АСРЕ | Average | 
| Grade 
ACPE Total MV | A, | 120 | 23 83 
(raw score) MN | .29 | аб | 23 2 
First-Year College MV .57 | 4o | T 72 
Average Grade MN .29 | 18 
Validity coefficient for combined group: 44 
II. Analysis of Covariance Results: 
: a value 
ability that a va 
Hypothesis Chi- Degrees елы og Res oaie 
ч . E 
à шае Freedom would arise by chat 
E. ul M ——— HÀ 
A. Equality of errors of estimate 2.872 I Between -05 m] as 
B. Equality of slopes х 3-323 I Between +05 f d Ec 
. Equality of intercepts 3.622 1 Between .05 ci 


validity cocfficients for Veterans and nonveterans 


was found for this group at Midwest City; the 
correlations. are +57 and .29 for veterans and 
nonveterans respectively, Although 62 per cent 
of the veterans exceed the average nonveteran, 


the difference is not significant because of the 
small number of cases, 


6. Summary 


The results for the six groups from 
five state and municipal colleges of arts 
and science are in general simil 
those found for the private instit 
For the private colleges, the veterans 
showed higher achievement in Six out 
of seven cases, but the difference was 
significant (at the 2 per cent level) in 


ar to 
utions, 


ificance of difference (from TIC above) 


Male Veteran 
0.22 
0.31 


бе - 
Not significant 


arts col 
our 
the 


only one case. For the public fi 
leges, the veterans were superior p 
out of six cases. The superiority v gent 
Veterans was sienificant at the 1 D etate z 
level for one institution (Central results 
At another (Western State) the 1 uous 
Of the significance test were атр esti- 
because of difference in errors 0 2 pe 
mate, which was significant at ds 
cent leve], 

The tendency for high-schoo к. 
to have greater validity for Dum e 
than for veterans is verified in on tX 
but at Central State the coefficien 
the same for both subgroups. 


1 standing 
erans 
cases 


Р 


ACADEMIC ACHIEVEMENT OF VETERAN AND NONVETERAN STUDENTS 27 


C. GRADES or VETERAN AND NONVETERAN 
STUDENTS IN ENGINEERING COLLEGES OF 
STATE AND MUNICIPAL UNIVERSITI 


1. Midwest Technological Unive ну 


ye енне Technological University, a num- 
hove anoles were studied in addition to 
есы ee ha in the basic comparisons of 
count Кү nonveterans, which took into ac- 
Өте o igh-School Average Grade and total 
For thie, the ACE Psychological Examination. 
tests qp d attention was given to placement 
gardés : English and mathematics, to the average 
йд = and credits earned during each quarter, 
mati course grades in English and in mathe- 
cs, 
pe Technological University is a land- 
state Ере in a state which also supports a 
the уау Students who are residents of 
арргор = аге admitted upon completion of an 
priate high-school program, Students in 


the different branches of engineering take a 
common freshman year, which includes chem- 
istry, drawing, English, college algebra, trigo- 
nometry, and analytic geometry. The group 
selected for study may be defined as follows: 
students who entered as beginning freshmen in 
the fall of 1946 and who completed three quar- 
ters of engineering college work, with ten or 
more hours of academic work each quarter. 
The criterion, quarter average grade for the 
three semesters of the freshman college year, is 
based on a five-step scale with the numerical 
values 4 to 0. 

Comparison of the means of veterans and non- 
veterans on the predictive measures showed 
that the average veteran excelled on only one 
predictor, the English test, although the dif- 
ferences were generally small. On the mathe- ™ 
matics placement test, the advantage of the 
nonveterans amounted to about half of a stand- 
ard deviation. Veterans were higher in college 
average grades during each quarter and in the 
courses studied separately, as well as in over- 


TABLE 16 


COMPARISON or AVERAGE GRADES EARNED BY VETERAN AN 
College of Engineering, Freshmen, 1046-1947 


i Midwest Technological University, 
s Correlations, Means, and Standard Deviations: 


p NoNVETERAN MALE STUDENTS 


f 
Correlation wit 
Variable Se m.s [шаку “Мел | ЧОН 
group ACPE | Average | Average 
Grade Grade 
t: E 
ACPE (1945) Total MV 444 .60 13-7 3.5 ay 
converted score) MN -37 „61 14-4 3-5 т 
?. High-Scho 2 62 S 
ol MV .44 .62 .75 E 
Average Grade MN .37 185 2.96 .56 128 
3. First-Year College MV .бо .62 2.39 i E 
verage Grade MN 61 .83 2.24 3 


Il, 


lr, S9mbined group, .7o. 
nalysis of Covariance Results: 


Multiple Correlations (Variables 1 and 2 vs. Variable а): 


for MV, .72; for MN, .76; and for the 


Probability that a value 


ees À 

" Chi- Dest reater than obtained 

Hypothesis square Freedom would arise by chance 

D ; = tween .30 and .5о 

A, Equality of errors of estimate sn I poe rs d E 
: Equality of slopes 1.71 tk EC 
C. Equality of intercepts 39.780 Е Less узай шш 


IV, p; 
Difference between Subgroups with Ability 


Held Constant: 


Superior subgroup 
dvantage expressed in grade u 
Advantage expressed i 


nits 


"er cent of veterans excelling the averag 
(from I 


evel of significance of difference 


n standard error of estima’ 


Male Veteran 


0.30 
te units о. 19 
е nonveteran p 


IIC above) 
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all average for the year. The mean number of 
credits was greater for nonveterans in each of 
the three quarters. Correlations between num- 
ber of credits for each quarter and average 
grade for that quarter were found to be low and 
positive, for veterans and nonveterans sepa- 
rately, indicating a tendency for the better stu- 
dents to take heavier course loads. 

The intercorrelations of the quarter averages 
ranged from .70 to .78'for nonveterans and from 
68 to .75 for veterans, the average for each 
group being about .73. Assuming a reliability 
of 73 for the quarter averages, use of the 
Spearman-Brown formula would predict that 
the reliability of average grades based on the 
three quarters would be .89. When it is re- 
called that this method of estimating rcli- 
bility tends to give an underestimate (because 
the three quarter grades are not random thirds 
of the freshman average grade), this figure may 
be considered satisfactorily high. 
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The results of the analysis of covariance are 
shown in Table 16. The multiple ай 
of the ACPE in combination with Ера. 
Аусабе are unusually high: .72 and .76 fOr po 
era nd nonveterans respectively, and 0. ked 
both Wbgroups combined. There is а modes 
tendenQ; for veterans to carn higher m 
than nonveterans of equal ability as dos in 
by the predictors used. Scventy-six pcr ee un: 
the veterans exceed the average nonvete ы 
which is the largest difference found in 
study of twenty-five different groups. 


2. Middle State University 


At Middle State, a number of predictors ang 
criteria were studied. Here, American Cor 
Psychological Examination total score, ation) 
School Rank, Year of High-School байо е 
First-Year College Average Grade, and апа- 
grades in drawing and mathematics Were 


TABLE 17 


Comparison or AVERAGE GRADES E. 


Crt DENTS 
ARNED BY VETERAN AND NoxvETERAN MALE STUDEN 

Middle State University, College of Engineering, 
I. Correlations, Means, and Standard Deviations: 


Freshmen, 1946-1947 


& Er 
Correlation with: | 
P Sub- m N 
Variable ist-Yr. Mean SD 
pon ACPE Н. x Average 
is Grade inse et 
1. ACPE (1937) Total MV 355 
(raw score) MN Re er E. : ee 5 
2. High-School Rank MV 3% 
(converted score) MN Eo = a fs 98 
3. First-Year College MV 5 | 35% 
Average Grade MN 38 = ped 4 бо ш 
(4-step scale) s | 9962 i 
| | 
II. Multiple Correlations (V. 


combined group, ЕЯ 
ПІ. Analysis of Covariance Results: 


ariables r and 2 vs, Variable 3): for MV,. 


he 
56; for MN, .53; and f° ‘ 


Tm 4 value 

Hypothesis Chi Degrees Probab that Sane 

squar of greater than о hance 
| инее Freedom would arise by chan 

A. Equality of errors of estimat 5 
. е | 3 3 

B: танау of slopes 958 x | Deren бе and ло 

‚ Equality of intercepts 8.816 ә Ee or 
sc ess than . 


IV. Difference between Subgroups with Ability 


Held Constant: 


Superior subgroup 


| eteran 

Avantage expressed in grade units меу 
vantage expressed in standard er i : 

Per cent of veterans excelling the Be нш units "t 

Level of significance of difference (from IIIC aed 196 
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TABLE 18 
Comparison or DRAWING GRADES EARNED BY VETERAN AND NOoNVETERAN МАГЕ STUDENTS 
Middle State University, Cole of Engineering, Freshmen, 1940-1947 
I. Correlations, Means, and Standard Disiations: 
£1 


Y 
i Correlation with: 
Vati Sub- 
ariable group H.S. | Drawing Mean SD N 
ACPE Rank Grade 
т. ACPE (1937) Total MV .46 +23 88.1 кы 352 
(raw score) MN -49 .18 93.1 22.3 98 
2. High-School Rank MV .46 E 15.6 3-1 352 
(converted score) MN .49 14 1б.4 3-3 98 
3. Drawing Grade— MV 23 27 9.71 8 
wing Gra Е E : E 352 
First Quarter MN 118 “14 0.53 x9 ES 
(s-step scale) 


It. Multiple Correlations (Variables 1 and 2 vs. Variable 3): for MV, .36; for MN, .19; and for the 
m Combined group, .26. 
- Analysis of Covariance Results: 


Degrees Probability that a value 


Hypothesis Chi- of greater than obtained 


ы iaa Freedom would arise by chance 
n Equality of errors of estimate 2.197 1 Between .то and .20 
b Equality of slopes 1.492 "ES Between .30 and .50 

. Equality of intercepts 6.849 Vise Less than .or 


- Difference between Subgroups with Ability Held Constant: 


Superior subgroup Male Veteran 


Advantage expressed in grade units К 0.25 
Advantage expressed in standard error of estimate units 0.30 
Per cent of veterans excelling the average nonveteran 62 
Level of significance of difference (from IIIC above) 196 
lyz " 
yzed. A unique feature of the analysis of The ACPE was given to high-school students 


Mid 
dle State data is the comparison 


With н о т 
ear pene not only on the basis of First- 
in mathe’ Grade, but also on their grades cenu 

i ematics and drawing. In all three com- 


Paris А 
i Sons, differences іп High-School 


in ACPE 
Маалы total score were taken into account. 
i € State is a large state university located 


ina mi 
Midwestern ci 
drawn fr stern city. Students of eng 


half or 9m graduates ranking in 
Engli their high-school classes. 


Cours, 

е; 2 

studied for engineering students, The group 
Were may be defined as follows: students who 


as 
ге; Д 
pleeg Len in the fall of 1946 anc 
Or more arce quarters of work, inclu 
qs hours each quarter. 
total Predictors employed in the stu 


Sco ies f 
Coun re on the 1937 edition of the American 


cil Psy 


chological Examination 
terms of gical Examinatio 


sh 4 ” i 
» mathematics, and drawing are re uired 
5 


admitted to the College of Engincering 


raw score) and High-School Rank. 


in their senior year throughout the state. Rank 
in high-school class was converted from рег- 
le ranks to a standard scale with a mean 
of 13 and a standard deviation of 4. 

The principal criterion employed is the First- 
Year College Average Grade based on a four- 
category scale having the equivalent numerical 
values of 3 to o. First-quarter grades in engi- 
neering, drawing, and mathematics were used 
as additional criteria. For these variables, a 
five-step grading scale was used, the values 
ranging from 3 to —1. Still another variable, 
Year of High-School Graduation, was used. 

Study of the year of high-school graduation 
showed that most nonveterans Were graduated 
in 1946, while the typical veteran last attended 
high school in 1943. Veterans, of course, showed 
much greater variability with respect to this 
measure. For veterans the correlations involv- 
ing year of graduation range from .20 (with 
High-School Rank) to —.o1 (with Drawing 


of veterans 


Rank and 


ineering are 
the upper 
Chemistry, 


1 who com- 
ding eleven 


dy included 


(expressed 
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Grade). Except for the r of —.o1, the remain- 
ing four correlations are positive and above 08, 
which indicates a very slight tendency for the 
more recent high-school graduates to be -su- 
perior. Such a relationship could easily result 
from admissions policy or a process of self- 
selection and does not necessarily reflect a gen- 
eral tendericy. 

The best predictor of First-Year Average 
Grade is High-School Rank. The ACPE yields 
a validity coefficient for veterans which is con- 
siderably higher than for nonveterans; the co- 
efficients are .42 and .98. As might be expected, 
the Drawing Grades are not well predicted by 
either of the predictive measures used. Validity 
coefficients for Mathematics Grades are some- 

€ what higher and are of about the same magni- 
tude for veterans and nonveterans. 

It may be noted that the correlations between 
Mathematics Grades and First-Year College 
Average Grades were .75 for nonveterans and 


-76 for veterans; the corresponding figures E. 
Drawing Grades with Average Grades mr 
and .50. The correlations between Drav tor 
des and Mathematics Grades were .19 
nonteterans and .go for veterans. 

Те analyses of covariance were computed 
for tè data at Middle State University, Ос 
for each of the criteria employed. The EE 
for First-Year College Average Grade are Sens 
in Table 17. The advantage of veteran em С 
in First-Year Average Grade at the Co ч. hly 
Engineering at Middle State University is big 
significant, ET 

"Table 18 presents the results shore DIS k 
Grade is used as the criterion. This eriteris is 
less predictable than either of the others; 
three multiple corrclations arc 30, 19) s 
The intercepts are significantly different 
1 per cent level, , in 

The results of the analysis of covariance ij. 
which Mathematics Grade is used as the 


t the 


TABLE 19 


_ COMPARISON oF MATHEMATICS GRADES EARNED By УЕ; 


Middle State University, 


ENTS 
TERAN AND NONVETERAN MALE STUD 


College of Engineering, Freshmen, 1946-1047 


I. Correlations, Means, and Standard Deviations: 


ae € 5 Correlation with: N 

H ub- 

Variable group p» H.S Math. Mean SD 

PE | mank | Grade i 

1. ACPE (1937) Total | MV й 35; 
(ràw score) М a 34 E ў Э 2 

2. High-School Rank му] | 355 
(converted score) MN i pA Te us E Ds 

3. Mathematics Grade — MV 358 
First Quarter MN 3t d pid F е ге 98 
(s-step scale) ] B 9:89 ' : 


Il. Multiple Correlations (Variables x 
combined group, -43- 
III. Analysis of Covariance Results: 


and 2 vs. Variable з): for MV, .44; for MN, „41; and fo 


г the 


\ с T a value 
Hypothesis Chi | Degres | Probability абаа 
Square ol greater ‘han | chance 
reedom would arise by 
А. Equality of errors of estimat: a 
B. Equality of slopes Е о 1 Dee p a „70 
- Equality of intercepts 4.342 3 Весе 102 and -05 


IV. Difference between Subgroups with Ability Held Constan 


©: 


Superior subgroup 
dvantage expressed in grade units 


Male Veteran 


.24 
vantage expressed in Standard error of о 2 
Per cent of veterans excelling the average по таке Units СУ 
Level of significance of difference (from шс above) 5% 
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TABLE 20 
Comparison OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 
Midwest City University, College of Engineering, Freshmen, 1946-1947 
I. Correlations, Means, and Standard Djpiations: 


1 " = 
Correlation with: 


Variable Sub. 1st-Yr. Mean SD N 
group ACPE Average 
Grade 
ACPE Total 
MV .45 118 19 16 
(raw Score) MN .36 115 20 І «d 
First-Year С Y 
ollege MV sas +34 : 16 
Average Grade MN x 3.32 Uu 171 
Validity coefficient for combined group: .40 > 


II. Analysis of Covariance Results: 


Chi Degrees Probability that a value 
Hypothesis soi E greater than obtained 
square Freedom would arise by chance 
A. Equality of errors of estimate 1.184 I Between .20 and .30 
Equality of slopes 0.646 1 Between .3o and .5о - 
Equality of intercepts o.IOI т Between .7о and .8о 


II i 
І. Difference between Subgroups with Ability Held Constant: 


Male Nonveteran 
0.02 
0.03 


Superior subgroup 

dvantage expressed in grade units 
Advantage expressed in standard error of estimate units 
Per cent of veterans excelling the average nonveteran 


49 
Level of significance of difference (from ПС above) Not significant 


terio P 
are a are shown in Table 19. The intercepts Midwest City is well known for its practical 
in t 8nificantly different at the 5 per cent level emphasis. The sample upon which the analysis 

€ case of this criterion. was based may be defined as follows: students 


Fo: ` Dai ү 
T all three criteria used at Middle State, entering as beginning freshmen in the fall term 


th 
of 1946 who completed the full academic year 


ae veterans proved to achieve significantly 
is mo des than nonveterans when allowance 1946-1947- » 1 
Mathem for the difference in ability. When The results of the analysis are shown in 
ever, NE Grade is used as the criterion, how- Table 20. In the College of Engineering at 
Per ere difference is significant at only the 5 Midwest City the veteran and nonveteran stu- 
level. dents are unusually similar with respect to 
college achievement in relation to aptitude. 


3. Midwest City Universit 
The analysi у н d 4. Southern Technological University 
at Mig ysis of data for engineering students an 
of dwest City was limited to a comparison Analysis of data for engincering students at 


Southern Tech was limited to a comparison of 
the relative achievement of male veteran and 
nonveteran students after allowing for differ- 


eir H " 

fo; iffe relative first-year grades after allowing 

ounci] шы in total score on the American 
Li Sychological Examination. 


dos ie students in arts and science, Mid- ences in total score on the American Council 
the up Y engineering students are drawn from Psychological Examination. In order ta secure 
Yating a two-thirds of their high-school grad- enough cases to warrant analysis, it was neces- 

B classes, As freshmen, they take English, sary to combine students who entered in the 


lege m descriptive geometry, chemistry, col. fall of 1945 with those who entered in the 
ang uA, trigonometry, analytic. geometry, fall of 1946. р - 
CChanics. The engineering program at Southern Tech is the land-grant college for 
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TABLE 21 5 ith 
л in NON < MALE STUDEN 
Comparison OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE 


Southern Technological Universi 
(Students who entered as freshmen 
I. Correlations, Means, and Standard Deviations: 


College of Engineering 
fall, 1945, or fall, 1946) 


Correlation with: | 


N 
А Sub- ме 5р 
Ы 151-Үг. | Меап 
аы group ACPE Average 
Grade | 
120 
ACPE Total MV .48 III 2 50 
(raw score) MN 41 109 
120 
First-Year College MV 48 2.50 qe 50 
@ Average Grade MN «4I 2.22 . 
Validity coefficient for combined group: .46 DR 
II. Analysis of Covariance Results: e = 
T ta value 
: Degrees Probability that a \ 
Chi- an obtaine 
ypoth of reater than 
Hypothesis square тоа И SU arise by chance _ 
50 
A. Equality of errors of estimate 0.956 I Between .30 ano E: 
- Equality of slopes 0.885 I Between .30 ena 02 
- Equality of intercepts 74 3 6.110 1 Between .or 


e 


III. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 


dvantage expressed in grade units 
Advantage expressed in sta 
Per cent of vi 
Level of signi 


» algebra, trigo- 


the fall of 1945 
completed three 
including eleven 
during the aca- 
they entered. Students 


quarters of engineering work ( 
or more credits рег quarter) 
demic year in which 
who received ten or 


more credits їп Specific 
subjects for training received while in the 
armed services were not considered to be “be- 


ginning” freshmen and Were excluded, 

The following information may aid in inter. 
preting the results presented in Table 9): the 
criterion, First-Year College Average Grade, is 
based on the work of the three quarters of the 
freshman year. Grades are based on a five-step 
scale of 4 to o. The only predictor used was the 


andard error of estimate units 
'eterans excelling the average nonveteran 52 
ficance of difference (from ПС above) 


Male Veteran 
0.25 


б; 
total raw score оп the American Council pet 
logical Examination, The hypotheses © ot dis- 
errors of estimate and equal slopes ате nents i 
Proved, but the difference in interceP 
Significant at the 2 per cent level. 

5. Summary гетй 
In three of the four enginee to 
Schools studied, veterans were di 
earn higher freshman average 8 ce 0 
than nonveterans, when the e if- 
ability differences is eliminated. Т. sities 
ference found at two of the gene” 
Would be expected to occur by : an 
less than once in a hundred times vic 
at the third institution less than еве 
in a hundred. At the remaining dn be- 
there was practically no aman 
tween veteran and nonveteran stu 


4-- —— 
AAM 


y 
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although what difference occurred was 
in favor of the nonveterans. At one uni- 
versity, the veterans were also found o 
De better grades than nani tt 
td ont ability level in two courses, 
g and mathematics. 
Ne tendency was found at Midwest 
inh € the abler students, as judged 
п: у predictor variables and college 
ene) Ы take the heavier course loads. 
Pret nig tended to take slightly 
ler course loads than the veterans. 
"e: gite standing has usually been 
sse рена grades better for non- 
Midwest Sus veteran students, but at 
torio = the opposite conclusion 
differen hed, and at Middle State the 
ce in validity was small. 


D.G 
Sr RADES OF VETERAN AND NONVETERAN 
Өте 
ead IN AGRICULTURE AND BUSINESS 
JOLLEGES IN STATE UNIVERSITIES 


а. Mi A Saa 
Midwest Technological University 


Miis artes in the College of Agriculture at 
undertake ech, a fairly extensive analysis was 
Variables ie Intercorrelations of the following 
le кеб studied: part and total scores on 
tion, jo Council Psychological Examina- 
chool Ay, on an English placement test, High- 
Quarter et ned academic load carried for cach 
Srade for the freshman college year, average 
English Е, each quarter, and course grades in 
ment өы the comparison of relative achieve- 
Veterans mies male veterans and male non- 
total score owance was made for differences 1n 
Verage С; on the ACPE and in High-School 
ege Av, rade; the criterion was First-Year Col- 

аве Grade. 
the Goes of the state may be admitted to 
Upon hen of Agriculture at Midwest Tech 
School со completion of an appropriate high- 
Чштеа pee English is the only course Te- 
Various n all agriculture students, although 
агре sup her courses are required for certam 
Ng the Б рор» of these students. Even dur- 
agricultural AYARA definite emphasis upon 
Preparing р subjects is present, and students 
What ai. or different specialties take some- 
€ analy rent programs, The group upon which 
students FS MAS based may be defined as follows: 
the en entered as beginning freshmen 
of 1946 and who completed three 


i 


quarters of work in the College of Agriculture 
(including ten or more hours of work each 
term) during the academic year 1946-1947. 

It was found that veterans tended to take 
slightly lighter course loads than the non- 
veterans, the difference amounting to about half 
a credit-hour. Number of credits correlated posi- 
tively with all the other measures, both pre- 
dictors and criteria, but no systematic differ- 
ence is apparent between veterans and non- 
veterans in the magnitude of the correlations. 
As in the other analyses where information on 
this point was obtained, the better students 
tend to take the heavier course loads. Com- 
paring the means of the predictors, we find that 
the nonveterans are higher only on the ACPE 
Quantitative score and on High-School Average. 
Without exception the veterans exceed the non- 
veterans on the criterion variables. 

Somewhat different results are obtained for 
veterans and nonveterans with regard to the 
validity of the predictors. For nonvetcrans, 
High-School Average is unquestionably the best 
predictor of quarter average grades, while for 
veterans the English test appears to be gen- 
erally superior. For predicting. grades in Eng- 
lish, the English test is again relatively better 
for veterans than for nonveterans. 

The analysis of covariance results are shown 
in Tablé?se« The ACPE and High-School Aver- 
age were selected as the predictors, and the 
criterion. was First-Year College Average Grade. 
The standard errors of estimate were signifi- 
cantly different at the 2 per cent level; grades 
of nonveterans tended to be more predictable. 
The equality of the slopes of the repression 
planes was not disproved, but the intercepts 
were found to be significantly different at the 
1 per cent level. The test of the significance 
of the difference in intercepts is difficult to 
interpret in the light of the outcome of the 
test of Hypothesis A. 


о, Midwest State University 


ic data for students in the 
f Midwest State University 
was limited to a comparison of achievement 
after allowing for differences in scores on the 
Ohio State University Psychological Examina- 
tion. 

Midwest State is a large coeducational state 
university located in a large city. Students who 
are residents of the state are admitted upon the 
n of an appropriate high-school course 
of study. Students of business are required to 
take courses in English, economics, business, 
and geography, and to meet certain broader re- 
quirements during their freshman year. The 
group to be studied is defined as follows: 
students who entered as beginning freshmen 


Analysis of academ 
College of Business o 


completio 
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TABLE 22 
Comparison ОЕ AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN MALE STUDENTS 
Midwest Technological University, College ofed griculture, Freshmen, 1946-1047 


I. Correlations, Means, and Standard Deviations: 


sib Correlation with: | 
ub- ! 7 
Variable group H.S. 1st-Yr. Mean SD N 
ACPE | Average Average | 
Grade Grade j 
1. ACPE (1945) Total MV .38 +52 11.9 3.9 He 
(converted score) MN -49 48 II.$ $895 | 
| 
2. High-School MV .38 .56 ер | 22 
Average Grade MN -49 | .68 59 
55. First-Year College MV .52 ‚56 2.30 ‚бо a 
Average Grade MN 48 | 68 2.15 LE ea 


II. Multiple Correlations (Variables т and 2 vs. Variable 3): for MV, .65; for MN, .70; and f 


combined group, .64. 
III. Analysis of Covariance Results: 


or the 


ET ]ue 
Т " Degrees Probability that a và 
Hypothesis aes ef greater than obtained 
РЧ Freedom would arise by chanc! 
А, Equality pi errors of estimate 5.425 1 Between .or mid 79 
- Equality of slopes 7 2.357 Between .30 and - 
С. Equality of intercepts ваг | 16.137 1 ii than „от m 


IV. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 
dvantage expressed in grade units 


Male Veteran 


i 0.23 
рүш expressed in standard error of estimate units ee 
r cent of veterans excelling the average nonveteran 11 
evel of significance of difference (from ПС above) Ambiguous 


of credit. in Specific courses for 
ceived during service were excluded from th 
group. The results for Midwest State business 
students are presented in Table 23. 


Waining re. 


[ five 
Average Grade, was based on a scale 0 The 


4 T О. 
categories having the values of 4 to 


„gression 
errors of estimate and slopes of the "егеп 
lines did not prove to be significantly different 


but the intercepts were significantly 
at the 5 per cent level, 


9. Littletown State University 


А at 
For students in the College of ШШШ E 
Littletown State, analysis was limited to E an 
Parison of the achievement of male ME if 
ponveteran students, taking into accoun oun” 
ferences in total scores on the American оп 
cil Psychological Examination. The Cade: 
again is First-Year College Average ae he 
Residents of the state were admitted of 8 
College of Business upon completion school- 
dpPropriate course of study in high 55^. 
hose with poor high-school records W sis. 
mitted on somewhat of a probationary 


) 
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TABLE 23 ` s 


Comparison or AVERAGE GRADES EARNED BY 


VETERAN AND NONVETERAN MALE STUDENTS 


Midwest State University, Glate of Business, Freshmen, 1946-1947 


ЈЕ ati iati 
Correlations, Means, and Standard Tiytiations: 


Korrelation with: 


Variable Sub- -Y 
group OSPE pem Mean | зр ^ 
Grade | 
OSPE 
MV .59 12.0 3-2 232 
(converted score) MN 35 13.2 aio 38 
First-Yea, 
ar College MV 3 2 .65 232 
Average Grade MN 32 2.22 : zm A 
Validity coefficient for combined group: -57 
I > 
І. Analysis of Covariance Results: 
Chi Degrees Probability that a value 
Hypothesis e of greater than obtained 
square Freedom would arise by chance 
A. Equality of errors of estimate 1.201 I Between .20 and .30 
C. Equality of slope 1.189 I Between .20 and .30 
+ Equality of intercepts 5.029 I Between .o2 and .o5 
П ; » 
I. Difference between Subgroups with Ability Held Constit: 
Male Veteran 


Superior subgroup 


Advantage expressed in grade units o.18 
Advantage expressed in standard error of estimate units 0.33 
Per cent of veterans excelling the average nonveteran 63 
Level of significance of difference (from IIC above) 596 


St 
Sey of business were required to take 
to meet and a survey course in business and 
their а broader requirements during 
study ma hman year. The group selected for 
who Ed defined as follows: male students 
of 1946 ме as beginning freshmen in the fall 
ludin = who completed two semesters, Ш- 
Thee onn or more hours of credit in each. 
Significant c ts are presented in Table 24- No 
ls Of coy differences were found, in the analy- 
Veterans ariance, although 59 per cent of the 
exceeded the average nonveteran stu- 


ent i 
State in the College of Business at Littletown 


4. Summary 


o veterans proved to be superior 
se v s ida se with respect to col- 
At the forc (in relation to ability) 
óm b ingle agriculture college and in 

usiness colleges studied. The dif- 


ference was significant at the 5 per cent 
level in one instance (Midwest State 
College of Business). The difference was 
not significant in the case of the business 
students at Littletown State, and was 
ambiguous for agriculture students at 
Midwest ‘Tech. 

The tendency for veterans to take 
lighter course loads than nonveterans 
was again found for agriculture students 
at Midwest Tech, and again the tend- 
ency was noted for the more able stu- 
dents to take heavier loads within each 
subgroup. High-school standing was 
again found to yield better prediction 
of grades for male nonveterans than for 
veterans. 
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TABLE 24 
{р NONVETERAN MALE STUDENTS 
Comparison OF AVERAGE GRADES EARNED BY VETERAN AND NONVETERAN МАЦ 
Littletown State University, College of Rusiness, Freshmen, 1946-1047 


I. Correlations, Means, and Standard Deviations: 


. Correlation with: | А 

1 

Variable Sub: ist-Yr. Mean SD 
group ACPE Average 
Grade 

142 
ACPE Total MV .55 106 25 65 
(raw score) MN .57 107 2 » 

= T 
First-Year College MV 355 2.34 { a 65 

Average Grade MN 257 2.2 


Validity coefficient for combined group: 


56 
II. Analysis of Covariance Results: 
= А alue 

Chi Degrees Probability pete 
hesi Я of reater that S ICE 

Hypothesis square Reesor БОШЧА arise by chan 
i and .79 
A. Equality of errors of estimate 0.347 I Between ado 205 “90 
В. Equality of slopes O.OIQI I Between .80 and .20 

C. Equality of intercepts 2.436 I Between .10 4 


III. Difference between Subgroups wif Ability Held Constant: 


Superior subgroup 
Advantage expressed in grade units 
Advantage expressed in sta 
Per cent of veterans excelli 
Level of significance of diff. 


ndard error of estimate units 
ng the average nonveteran 
erence (from IIC above) 


Male Veteran 
о.12 
0.23 


59, 
Not significant 


E. GRADES ОЕ INTERRUPTED VETERANS AND 
UNINTERRUPTED NONVETERANS 


In the studies so far reported, the 
first-year average grade has been u 
as the primary criterion, 
do college work has bee 
the basis of one or more 
lastic aptitude, tool skills, or achieve- 
ment in high-school subjects, used wher- 
ever possible in combination with a 
measure of high-school standing. In the 
studies of interrupted veterans, however, 
the veteran is in a sense compared with 
himself as a nonveteran. The interrupted 
veteran, as defined here, is a student who 
attended college for a certain period of 
time (usually one year) as an ordinary 


sed 
and ability to 
П assessed on 
tests of scho- 


єй. 
кын Я enter 
civilian student, after which he 


military service; upon compii ane 
military service, he re-entered defined 
institution and completed a m ont 
amount of academic work фона that 
year). For such students it’ a o 
the best basis for evaluating ше : es ОП 
the student's intervening experien isd 
college achievement was a compa dent 
of his achievement as a civilian метеп! 
(before war service) with his achiev 
аз а veteran student. А 
In planning Һе analysis, 
thought likely that grades earned ntere 
the term just before the student € ical 
the armed forces might not be P jege 
since the prospects of leaving © 


: as 
it pe! 
during 


Y 
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shortly might lead the student to slacken 
his efforts in academic work. It was also 
Supposed that grades for the first teym 
following the return to college mighignot 
be typical, partly because backg und 
information and study skills might need 
refreshing before a student regained his 
original effectiveness, and partly because 
Students returning to college might be 
temporarily fired with an enthusiasm 
Which would not persist. In three of the 
и SURE studied, the first-term grade 

as used as the predictor and the fourth- 
term grade as the criterion, leaving out 
of consideration the doubtful second and 
third terms. The analysis of covariance 
method was again used, in order to com- 
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pare the second-term sophomore grades 
of veterans and nonveterans, taking ac- 
count of ability as indicated by grades 
earned in the first term of the freshman 
year. 

1. Adams University 


A relatively elaborate study was made of the 
group containing interrupted veterans at Adams 
University, in order to obtain a more complete 
picture of the relationships of~a number of 
pertinent. variables. In this study, the typical 
definition of groups was made: veterans com- 
pleted one year before war service and one year 
afterward; nonveterans entered in the fall of 
1945 and completed two consecutive years ot ? 
college work. Students not enrolled in the arts 
and science curriculum, and veterans given ad- 
vanced standing for college training during their 
service were excluded. 


The intercorrelations obtained for the two 


TABLE 25 


INTERCORRELATIONS OF SCHOLASTIC APTITUDE TEST 
ND SECOND-YEAR COLLEGE AVERAGE GRADES 


College of Arts and Science 


PREDICTED GRADE, AND FIRST- А? 


Adams University, 


(Veterans who completed one year before war service, and on 
nonveterans who entered in the fall о! 


Adjusted School Rank 


SAT-Verbal 


SAT-Mathematics 
Adjusted School Renk 
Predicted Grade 
ist-Semester Average 


2па-Ѕешев+ег Average 


3rd-Semester ‘Average 


lth-Semester Average 


Interrupted Veterans 


Scores, ADJUSTED SCHOOL RANK, 


e year after war service; 
f 1945 айу completed two years.) 


Male Nonveterans (32111) 


Predicted Grade 


6.7 


Была pue par тә 66 


L 
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subgroups are shown in Table 25. The statistics 
above and to the right of the diagonal were 
obtained for the nonveteran subgroup, and 
those below the diagonal for the interrupted 
veterans. 

The hypothesis that FirstSemester College 
Average Grades would furnish a better predic- 
tion of Fourth-Semester Grades than tests plus 
high-school standing was verified. For veterans, 
the Predicted Grade, which was the best of the 
ordinary predictors, correlated .51 with Fourth- 
Semester Average; the correlation of First- 
Semester Average with Fourth-Semester Average 
was .59. For the nonveteran subgroups, how- 
ever, the difference was much less marked; the 
analogous correlations were .64 and .66. 

It is of interest to note that the validity 
coefficients of the two scholastic aptitude tests 
against the fourth-term averages are rather sim- 
ilar for veterans and nonveterans, but the 
validities for Adjusted School Rank and Pre- 
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dicted Grade are noticeably lower after bs 
interruption of training than during me aA 
college year. This finding is ge a 
the, previous observation that Higiesction e Sd 
ing \rdinarily has less predictive value 

М for nonveterans. А З 
i oa worthy of note that the inte 
lations of term grades which cross the m vii 
interruption (фе, all except fir жеде ш 
second-semester and third-semester УЗ. veterans 
semester) are considerably lower for 1 mili- 
than for nonveterans. This suggests à have 
tary service or other related ере “me yet- 
affected the academic performance о 
маса for the veterans ате slightly, po 
on most of the predictive measures, s are 
First- and Second-Semester Average Ста ades 
lower than for nonveterans. The average E he 
for the third and. fourth pesn ‘will be 
other hand, are higher for veterans. Tt 


TABLE 26 
;TERAN 
Comparison or AVERAGE FOURTH-SEMESTER GRADES EARNED BY INTERRUPTED VETER! 
AND UNINTERRUPTED NONVETERAN MALE STUDENTS 
Adams University, College of Arts and Science 


(Veterans who completed one year before war service, one year after war service; 
nonveterans who entered in the fall of 1945 and completed two years.) 
I. Correlations, Means, and Standarz, Deviations: 


pu—— 
Correlation with: 
Variable cod First-Sem. | Fourth-Sem. Mean SD s: 
Average Average 
Grade Grade A 
First-Semester College MV К 
Average Grade = MN | 1 "s E 7.8 i 
Fourth-Semester College MV т 
Ауегаре Сгайе P MN К о 6:7 EJ 
Validity coefficient for combined group: 61 
П. Analysis of Covariance Results: 
а а yalue 
Hypothesis Chi- Degrees Probability te tained 
Square of greater th chance 
Freedom would arise by 
A. Equality of errors of esti z 
B. Equality of slopes as та 1 en ЎА and E 
C. Equality of intercepts 8. 298 - K Lees ат. JOE 


III. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 
Advantage expressed in grade units 
Advantage expressed in stan 
Per cent of veterans excellin 


Level of significance of difference (from II 


dard error of estimate units 
g the average nonveteran 


Male Vetera? 
1.92 
0.38 


65 
€ above) І % 


= m 0. TX. —À— m EE Lo ERO s 
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NS x the mean Predicted _Grade for 
nme. wes 72.8 and the mean First-Semester 
AM was almost the same: 729- The non- 
Ше рс ү the prediction slightly more; 
Ties dicted mean grade was 745 ап hc 
s of the First-Semester Average Grade was 
3 i second term, the veterans? mean 
kans acean unchanged, while the nonvet- 
Шеп хой За grade increased slightly. There is 
the ыыы slight evidence for believing that 
e cine of being drafted did lower the 
ent. achievement of veterans to some ex 
M poss an of covariance results, comparing 
Eee e of Fourth-Semester Grades on 
and se d Grades for interrupted ЖеШТаПЕ 
26. The ee! nonveterans, are shown ІП Table 
and —Q роте of equal errors of estimate 
ые 33 are not disproved, but the 
A signif ° the regression lines are found to 
Sixty-five anny different at the 1 per cent level. 
excel the per cent of the interrupted veterans 
ter Grad average nonveteran in Fourth-Semes- 
ее when adjustment 15 made for ability 
age Gr: es as measured by FirstSemester Aver- 
rade. 

ES ennt is particularly striking in view 
man Ше previously reported for the fresh- 
DE tue. стан апа nonveteran students at Adams; 
found io no significant difference was 
would CR a relatively small difference 
ave been significant because so many 
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WES 


students were included in the analysis. In the 
freshman group, only 52 per cent of the veterans 
excelled the average nonveteran. 


2. Stewart University 


At Stewart, the only variables taken into 
consideration were the average grades earned 
during the first four semesters of college work. 
As at Adams, the study involved a comparison 
of nonveteran students with veterans who had 
completed two full semesters of college work 
in the arts and science college, who were inter- 
rupted for military service, and who subse- 
quently completed the two semesters of the 
sophomore year following their return from 
military duty. The nonveterans chosen for 
comparison entered in the fall of 1945, and com- 
pleted two full years of college work. Transfer 
students and students given advanced standing 
for military training were eliminated. The pre- 
dictor used was the First-Semester Average 
Grade, and the criterion was Fourth-Semester 
Average Grade. The grading system involved 
seven categories which were given the values of 

to 1 for purposes of analysis. 

The intercorrelations, means, and standard 
deviations of the four semester average grades 


for nonveterans and interrupted veterans аге - 


shown inf Table 27- The intercorrelations are 
uniformly lower for veterans than for nonveter- 
ans, but the differences are especially large for 


TABLE 27 


INTERCORRELATIONS OF 


First- AND SECOND-YEAR COLLEGE AVERAGE GRADES 


Stewart University, College of Arts and Science 


(Veterans who completed one year befo 
non 


IFirst-Semester College 


а 


Third-Seme 


Fourth-Semester Colle 


Interrupte 
Veterans (X: 


Average 


Standard Deviation 


re war service and one year after war service; 
terans who entered in the fall of 1945 and completed two years.) 
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TABLE 28 m 
J ESTE ES EARNED BY INTERRUPTE! 
MPARISON OF AVERAGE Fou RTH-SEMESTER GRAD ; E 
m VETERAN AND UNINTERRUPTED NONVETERAN MALE STUDENTS 
Stewart University, College 


r D i ar after war service; 

á ^ лсе, one year after war s 

(Veterans who completed one year before wa: vice, y apos 
nonveterans who entered in the fall of 194and completed two years 


I. Correlations, Means, and Standard Deviations: 


Arts and Science 


Correlation with: 


N 
Variable Sub: | FirstSem. | FeurtinSem.| dem | 3D 
Soup Average Average 
Grade Grade 
S 86 55 
First-Semester College MV -67 ues 90 70 
Average Grade MN .68 5.04 а 
© Р .68 
~ Fourth-Semester College MV -67 5.38 182 70 
Average Grade MN .68 | 5.13 
- Validity coefficient for combined group: «65 _ 
II. Analysis of Covariance Results: Sao 
= Jue 
Chi Degrees set aug Ше 
i a f reater tha hance 
"орен Square: Freedom ould arise by chan 
and .20 
A. Equality of errors of estimate 1.756 1 Between de ind 100 
В. Equality of slopes 0.0489 Between . Es b 
C. Equality of intercepts [А 11.104 I Less than . 


III. Difference between Subgroups with Ability Held Const. 


ant: 


Superior subgroup 
dvantage expressed in grade units 
Advantage expressed in standard err 


Male Veteran 


0.32 
or of estimate units E 
om IIC above) m 


First-Semester vs, Third-Semester and Second- 
Semester vs, Third-Semester Average; the cor- 
relations are much lower for interrupted veterans 
than for the nonveterans, presumably because 
of influences related to the period of war service, 
It is interesting. to note, however, that the 
correlations of First- and Second-Semester Aver- 
ages with Fourth-Semester Average, Which also 
bridge the period of interruption for veterans, 
do not show nearly as great a difference, 

The means of veterans’ grades are lower for 
both first and second semesters, but higher for 
third and fourth semesters than the grades of 
nonveterans. Both subgroups show a decrease in 
mean grade from the first semester to the sec- 
ond, and the difference is nearly the same for 
both subgroups. Apparently, either the anticipa- 
tion of induction did not result in a letdown 
for the veterans, or the letdown was equally 
influential during both terms of the freshman 
year. 


The magnitude of the intercorrelations be- 


ests that 
tween adjacent semester averages SUBE 
the grades are reasonably ушЫ, 
Turning to Table 28, it will 
the correlations between the о ке were ^ Phe 
employed as predictor and СЕРОВ erai: 1 
97 for veterans and .68 for har differences 
analysis of covariance shows that pnis are e 
errors of estimate and regression S aP ercep cr 
significant, while the difference in ji the 1 ^us 
the regression lines is significant (іе ve e 
cent level. Seventy-two per cent of t гош! 


ester gr 


б yant! 
exceed the average nonveteran i allow? es 
Semester Grades when itl a sone ет та 
is made for differences in Еігзі-5ст 
А iversil 
3. Eastern City University ned 


c 
sis was COPC осе 
At Eastern City, the analysis W olleg 


ster 1р5 
only with First- and Koth- sems “he grou Fs 
Average Grades in arts and scienc manner А 
Studied were defined in the same тй 


re 
E попу 
Adams and Stewart, Uninterrupted 
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TABLE 29 
Comparison OF AVERAGE FOURTH-SEMESTER GRADES EARNED BY INTERRUPTED 


VETERAN AND UNI 
Eastern City Unit, 


(Veterans who completed one y: 
nonveterans who entered i 


I.' Correlations, Means, and Standard Deviations: 


NTERRUPTED NONVETERAN MALE STUDENTS 
ity, College of Arts and Science 


7 before war service, one year after war service; 
the fall of 1943 and completed two years.) 


Correlation with: 


Variable Sub- First-Sem. | Fourth-Sem. SD N 
group Average Average Mean 
Grade Grade 
First-Semeste: 
r College MV .49 о.19 .68 
Average Grade MN .бо о.2 65 1o 
Fourth-Semeste / 
г College MV .49 0.57 -58 7 
Average Grade MN 60 0.33 бо is 
Validity coefficient for combined group: 53 
II. Analysis of Covariance Results: 
Chi- Degrees Probability that a value 
Hypothesis square of greater than obtained 
gue Freedom would arise by chance 
B. Equality of errors of estimate 0.357 т Between .50 and .70 
. c Equality of slopes 1.374 far Between .20 and .30 
à . Equality of intercepts 13.779 1 Less than .or 


I е 
TT. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 


Male Veteran 


Advantage expressed in grade units 0.29 

Advantage expressed in standard error of estimate units 0.59 

Per cent of veterans excelling the average nonveteran 72 
IC above) 1% 


Level of significance of difference (from I 


conn in 1945 and who completed the 
Broup; Ns year comprised the nonveteran sub- 
freshmar de interrupted veterans completed the 
sophomon year before military service and the 
For Fus year after military service. 
Avera А of covariance, First-Semester 
Fours rade was used as the predictor; 
Citron. ane Average Grade served as the 
Categories avi grading system involved five 
Students having values +2 to —?. Transfer 
twelve аа students enrolled for fewer than 
elimin redits in any of the four semesters Were 
ninated, 
emit relationship between First- and Fourth- 
‘ity eee Grades was not as marked at Eastern 
Were at Adams and Stewart; the correlations 
"49 and бо for the two subgroups, as 
in Table 29. A similar pattern of mean 
was found, however. The results of the 
the - covariance are also similar to that 
ad two institutions. The hypotheses 
al standard errors and equal slopes are 


analysis 


not disproved, while the difference in inter- 
cepts is found to be significant at the 1 pcr 
cent level. Seventy-two per cent of the inter- 
rupted veterans are found to exceed the average 
nonveteran student. 


4. Midwest Technological University, 
College of Engineering 


At Midwest Tech, the nonveteran comparison 
group was composed of prewar students rather 
than a postwar group as in the three studies 
just discussed. In this study, it was possible to 
increase the size of the interrupted group con- 
siderably by introducing some flexibility into 
the defined pattern of interruption. In the 
three studies just discussed, the interruption oc- 
curred between the second and third semesters. 
At Midwest Tech a veteran whose college career 
was interrupted at any time after the second 
quarter and before the seventh quarter was 
considered to fall within the defined pattern, 
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provided that he completed at least eight 
quarters. As in the other studies of interrupted 
veterans, students who were given advanced 
standing for college training received as mem- 
bers of the armed forces were excluded. The 
nonveterans entered in the fall of 1939 and 
completed eight quarters of work; they were, of 
course, not interrupted. Transfer students and 
students who changed divisions within the uni- 
versity during the eight quarters were excluded 
from the study. Students who enrolled for 
fewer than 10 hours of work in any quarter or 
fewer than 12 hours in the first, second, or 
eighth quarter were also excluded, 

A summer term counted as a regular quarter, 
provided the student was registered for twelve 
or more credit hours. Students were also те- 
jected if they had not taken freshman mathe- 
matics or if they lacked a record of high-school 
standing. The same procedures described here 


riculture 
apply to Midwest Tech College of Agric 
students; the study of the agriculture E 
will be described in the following emo E 
n the analysis of the data, First- п poole 
Qu¥xter College Average Grass О 
апа used as a single predictor; v. The 
Averzze Grades were used as the сп Table 30- 
results of the analysis are shown a somewhat 
The validity coefficients tend to be involving 
lower than were found for the vw Stewart, 
interrupted veterans at Adams yam were 
probably because the criterion E note front 
earned at a time which is more Ems again 
the predictor grades. The veterans the initia 
found to earn lower grades during 
two quarters (the predictor) Квад. саа ( 
veterans; on the Eighth-Quarter TWO groups 
criterion) the relative position of the and slope 
is reversed. The errors of керез cantly dif- 
of the regression lines are not signi 


A TABLE 30 


COMPARISON OF AVERAGE EIGHTH-QU. 
VETERAN AND UNINTERRU 


(Veterans who completed two t 
after war service for a tot 


I. Correlations, Means, and Standa⁄ 


61 Deviations: 


" TED 
ARTER GRADES EARNED ny INTERRUPT 
PTED NONVETERAN STUDENTS 

Midwest Technological University, 


College of Engincering 


" 
а Š ix quarter 
© Six quarters before war service and two to six 4 


X al of at least eight quarters; nonveterans who 
entered in the fall of тозо and co; 


mpleted eight quarters.) 


Correlation with: N 
Variable Sub- c d 
а group: |? p Quarter 8th-Quarter Mean 
verage verage 
Grade Grade 8 
: 14 
First- and. Second-Quarter MV 13 їз 
College Average Grade MN 21 =з #94 4 
H ` ` a 
Eighth-Quarter Coll е му e : 9 
Average Grade Б MN re 2.38 dd ; 
Validity coefficient for combined group: so 
5 
II. Analysis of Covariance Results: 
value 
еу that a V2 
Hypothesis Chi- Degrees as Tn obtained 
t a 
pire Freedom Would arise by ©” 
A. Equality of errors of estimat al 
B. Equality of slopes n t "ig т нн ue and 3 
. Equality of intercepts Ec = Between гхо and 


ПІ. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 
Advantage expressed in grade units 
Advantage expressed in sta; 


ndard error of esti; i 
Per cent of veterans excelling the average pueda 
(from TIC above) 


Xt ve ng t 
Level of significance of difference 


Male Veteran 
о.11 
о.18 


37, - 
Not significa? 


t 
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TABLE 31 


COMPARISON OF AVERAGE EIGHTH-QUARTER GRADES EARNED BY INTERRUPTED 
VETERAN AND UNINTERRUPTED NONVETERAN MALE STUDENTS 


Midwest Technological A niversity, College of Agriculture 


(Veterans who completed two to six 


arters before war service and two to six quarters 


after war service‘for a total & at least eight quarters; nonveterans who 
entered in the fall of 1939 and completed eight quarters.) 


I. Correlations, Means, and Standard Deviations: 


Correlation with: 
Variable Sub | 7&2 Quarter | 8th-Quarter Mean SD N 
group Average Average 
Grade Grade 
Мз and Second-Quarter MV | -57 2.16 -63 57 
ollege Average Grade MN | .62 2.30 .бо 106 
Eighth-Quarter College MV 257 2.62 -69 57 
Average Grade MN .62 2.44 .59 106 
Validity coefficient for combined group: 57 
П. Analysis of Covariance Results: 
Chi Degrees Probability that a value 
Hypothesis i of greater than obtained 
square Freedom would arise by chance 
А. Equality of errors of estimate 2.901 fà Between .o5 and .то 
» 8. Equality of slopes 0.0000 1 Greater than .99 
Equality of intercepts 9.255 1 Less than .or 


п 


L. Difference between Subgroups with Ability Held Constant: 


Superior subgroup 


Male Veteran 


Advantage expressed in grade units 0.26 

Advantage expressed in standard error of estimate units 0.51 

Per cent of veterans excelling the average nonveteran 69 

Level of significance of difference (from ПС above) 1% 
рең. The difference їп intercepts is also involving interrupted veterans: the veterans 
Pecta to be within the range of chance ex- earned lower grades on the predictor and higher 
ius ^ 57 per cent of the interrupted vet- grades on the criterion measure. The advantage 
пер}, excel the average nonveteran. This engi- of the interrupted veterans is found to be sig- 
Brou 8 group at Midwest Tech is the only nificant at the 1 per cent level. Sixty-nine per 
Vetoes among the five involving interrupted cent of the interrupted veterans excel the aver- 


to abili where college achievement in relation 
i rs ity did not yield a statistically significant 
ence in intercepts. 


5- Midwest Technological University, 
College of Agriculture 


Fi С 
definig ез Tech students of agriculture, the 
ang үр Of the veteran and nonveteran groups 
Parallel pr of the analysis were in all respects 

“scribed i those for the students of engineering 

еви], n the previous section. 

Shown 15 ОЁ the analysis for this group are 
Show ine Table gi. The differences in means 


€ same trend as did the preceding groups 


age nonveteran at the Midwest Tech College 
of Agriculture with respect to Eighth-Quarter 
Grades when differences appearing in grades 
for the first two quarters are taken into ac- 
count. 
6. Summary 

In all five comparisons of interrupted 
veterans with male nonveterans, the vet- 
eran subgroup was found to be superior 
to nonveterans in achievement relative 
to ability. In these five comparisons, abil- 


ity was measured in terms of freshman 


es 


44 


college grades. In four of the five com- 
parisons the difference was significant at 
the 1 per cent level. The differences were 
generally greater in comparisons involv- 
ing interrupted veterans than in the com- 
parisons involving freshman students 
where ability was measured by tests and 
high-school standing. 

In all five of the studies it was noted 
that the interrupted veterans had lower 
mean scores for freshman grade than the 
nonveteran male students. This fact must 
be taken into account in interpreting the 
analyses of covariance results. For ex- 
ample, if the lower freshman grades are 
the result of a tendency to let down on 
effort in anticipation of being drafted, 
the effects of the interruption would be 
primarily a matter of depressing achieve- 
ment before service rather than enhanc- 
ing achievement after service. 

In addition to the possibility, that the 
freshman grades of the interrupted vet- 
erans were low because of a feeling that 
college work was unimportant in view 
of the war emergency, particularly since 
their college career might be interrupted 
before the end of the college year, there 
are other reasonable interpretations. One 
possibility is that there might have been 
a tendency for faculties to give higher 
grades in 1945, when the nonveterans 
were freshmen, than in the period two 
or three years earlier when the veterans 
were freshmen. Another possibility is 
that selective factors of some sort w 
operating w 
means for 


| еге 
hich tended to lower the 


the interrupted veteran sub- 
groups who returned without advanced 


standing gained in the various coll 


T ege 
training 


programs sponsored by the 
armed services. This seems а likely possi- 
bility, since students who were known 
to have had college training while in the 
service were excluded from the study, 


No direct evidence is available bearing 
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on the hypothesis of a letdown in pu 
pation of being drafted except the ii 
suggestion from the separate semes : 
mé&ns at Adams that there might hav 


A пт: the 
beet, a letdown in the second term i 
n increased 


nd-semester mean grade 
du 3 mean 


slightly over the .first-semester d 
grade for nonveterans, while for ae ae 
there was a slight decrease. A similar ie 
sult was not found at Stewart, isi n 
It would appear that if there was edi 
down, it affected both terms of the H 
man year to about the same extent. ew- 
Evidence from Eastern City and wae 
art University records shows that ere 
freshman average grade is rather w^ 
from year to year, which casts dou nidi 
the hypothesis of grades drifting ub de 
In addition, it has been shown ER che 
relationships of the mean grades 2 dm 
same at Midwest Tech, where the ther 
veterans entered in 1999, as at бес 


ea) 

Р i = Ч esis - 
three institutions, The hypoth ears 15 
= a 
the dif 
uiv 


grades drifting upward over the 


alents of semester averages were obtal! i 
based on the entire class for th? 
the percentile equivalents of a . the 
and Second-Semester Averages a 
median interrupted veterans WE е per 
35, while for the nonveterans t 
centiles were about 55. n of the 

The most probable explanatio” pied 
lower freshman grades of the inter те 
veterans is that selective p act 
Operating. Students with the ig ikely 
demic records are somewhat ш ind 
to have been rejected in our гегаіпё 
procedure because they меге : g pr^ 
in ASTP or V-12 college e for 
grams or because they were selec which 
other types of military training ant 
resulted in their being given ? 
Standing, 
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Е, TRENDS IN THE COLLEGE GRADES OF 
VETERANS AND NONVETERANS 


А As has previously been mentioned, jit 
artum that veteran students ar ӯ n- 
ally handicapped because of sucht fac- 
tors ‘as forgetting and deterioration of 
Study skills, which result in temporary 
underachievement. Another possibility 
15 that the veterans return to college 
fired with enthusiasm and good inten- 
— 5 lead to temporary over- 
that eie It is also, of course, possible 
Mita 3 háancéifecté occur, in the same 
they - | in different students, and that 
не 2-е to cancel each other. It was 
accordingly thought worth while to ex- 
метм the trends in grades of veteran 
onveteran students. 

ine grades by terms were obtained 
Айат groups, including the groups at 
rupted и чат which involved inter- 
нема veterans. The average grades 
and сан successive terms by veteran 
in Fiew у eteran male students are shown 
the К. 3 and 4. It will be noted that 
on the scale of grades has been shown 
Рета pw for all universities except 
ГА йөр us fact should be kept in mind 
ifs inet the graphs, since the vari- 
iy none average grades for large 
гени. ei students is not likely to be 
ative to the complete scale of 

Brades in use, 
A = for interrupted veterans 
cally Pip mnd Adams, shown graphi- 
scribed ; igure 3, have already been de- 
the itu the preceding discussions of 
Kany х data. At Adams, the vet 
Second.se not show the slight increase in 
ireen a average grade which is 
Bests ius the nonveterans, which sug- 
in effort е may have been some letdown 
At mius anticipation of being drafted. 
ound гч t, however, no such trend is 
ort n pparently any reduction in ef- 
sulting from the immuinence of 
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Fic. 3. Trends in Grades of Interrupted Vet- 
erans and Uninterrupted Nonveterans 


withdrawing from college for military 
service had about the same effect on 
both semesters. At Adams, the line show- 
ing average grades for the semesters fol- 
lowing return from war service is almost 
exactly parallel to the line for nonvet- 
erans. At Stewart there is some sugges- 
tion that the veterans did relatively bet- 
ter in the third term than in the fourth. 
The absence of any marked trend in the 
second-year mean grades of interrupted 
veterans suggests that forgetting or de- 
terioration of study skills was not an 
important determiner of postwar achieve- 
ment. If such deterioration did occur, 
it was apparently more than counter- 
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balanced by influences fa 
cess, 


Quar 
Midwest Tech. 


vorable to suc- 


Mean term grades were computed for 


3—Adams, West- 
Tech; at the lat- 


re shown graphi- 
ines for veterans 


and nonveterans are nearly parallel in all 
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Midwest Tech. (Agri.) = 1946 
and Nonveteran Male Students ja 
four cases. At Midwest Tech ней be 
slight tendency for the differ ; to 0 
tween veterans and a term 
greatest in the first of the me enc? 
There is again no consistent рё at 
that veterans are more handicap. as for 
the start because of such ced js 10 
getting; if anything, the tenden г" the 
Veterans to do relatively bette! in su” 
first term after war service than 
sequent terms, 


d 


т э 


III. SUMMARY AND INTERPRETATION 


The academic success of veteransAn 
college was early recognized as anj/im- 
portant subject for investigation because 
of its relevance to long-range formula- 
tions of educational and public policy. 
It was clear that the performance of 
Veterans had an important bearing on 
two major issues in higher education: 
No should go to college? and at what 
ur should the typical student enter col- 
ege? It was also clear that the perform- 
ànce of veterans in college was relevant 
to the problem of predicting college 
Success, a matter which has received con- 
siderable attention from psychologists, 
especially during the past thirty years. 
5. ain purpose of the present study 
Б Aia provide a reasonably clear answer 
es questions how did veterans and 
аре чы differ with respect to аш 
— dein On examination of this 
b n, it became evident that a num- 

er of specific steps must be taken in 
Order to minimize influences which 
might obscure the differences and thus 
pus a misleading estimate of their 

portance. In particular, the following 
Procedures were carried out: 
E es the diversity of Ameri- 
ie со leges and universities, studies 
lea: aT in cooperation with 16 col- 
ml" universities so chosen as to 
ties E. private colleges, state universi- 
deg municipal universities; coeduca- 
Hee Fas men's colleges; large universi- 
with nd relatively small colleges; colleges 
У ta financial resources and less 
in "n institutions; and colleges located 
Be cities as well as colleges 1n small 
towns, 
end The crucial comparisons in this 
bis were between male veterans and 
nonveterans who were enrolled in 
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the same division (e.g, liberal arts or 
engineering), in the same class (e.g. 
freshman or sophomore), of the same 
college or university. 

3. Differences between veterans and 
nonveterans in aptitude for college, as 
measured by conventional predictors of 
college success, were controlled by the 
use of analysis of covariance. 

4. Those veterans who had received 
a substantial amount of college training 
in the V-12 program or in the Army 
Specialized Training Program were ex- 
cluded from the comparisons. 

Separate comparisons were made for 
veteran and nonveteran students in each 
of 25 separate groups, each of which 
was homogeneous with respect to institu- 
tion, division within the institution, and 
academié’status of the students. In effect, 
in each college group veteran students 
were compared with nonveterans of the 
same ability. The estimates of ability 
which were employed were based, in 
most instances, on a test or tests of scho- 
lastic aptitude and achievement, or on a 
measure of high-school success used in 
combination with a test or tests of apti- 
tude and achievement. 

What, then, were the findings with 
respect to veteran-nonveteran differences 
in Adjusted Average Grade? In Figure 
5, 25 separate answers are provided, one 
for each group studied. Let us consider 
first the results for the 20 groups con- 
taining freshman students. 

For ease of interpretation, the results 
are presented in terms of the percentage 
of veterans excelling the average non- 
veteran in freshman average grade ad- 
justed in such a manner that any ability 
differences between veterans and non- 
veterans have been cancelled. If veterans 


48 FREDERIKSEN AND SCHRADER 
Y of Per Cent of Veterans Excelling the 
ранд Average Nonveteran 
Group 
[RE | sp a ip ip sp © i 8o so 100 
Ф " 


= - ICE 
GROUPS INCLUDING VETERANS WHO ENTERED Lu AS FRESHMEN AFTER WAR SERV: 


Midwest Tech., Engr. 
Midwest Tech., Agri. 
Southern Tech., Engr. 
Central State, Arts 
Middle State, Engr. 
Midwest State, Bus. 
Midwest City, Arte 
Evans, Arts 
Littletown State, Bus. 
Western State, arts 
Miller, Arts 

Stewart, Arts 

Central State, Arts 
Harris, Arte 

Adams, Arts 

Douglas, Arts 
Littletown State, Arts 
Midwest City, Engr. 
Eastern City, Arts 
Turner, Arts 
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Tepe eee 
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= 
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stem Racer 
DEEEITPEYEU энетил рчды 


GROUPS INCIUDING VETERANS WHO RETURNED TO COLLEGE AFTER WAR SERVICE AND 
HORVETERANS WHO ENTERED COLLEGE IN 


Eastern City, Arts 
Stewart, Arts 
Midwest Tech., Agri. 
Adams, Arts 

Midwest Tech., Engr. 


Em uy 


Fic, 5. 


G roups 


and nonveter. 
two adjusted-gr 
mean adjusted grades w 
and 50 per cent of the 
be found to excel the 
eran. 


THE YEAR SPECIFIED 


Level of Significance: 
level 


Sh level 


Per Cent of Veter: 
Average Nonveteran w 
Average Grade in Eacl 


ans were exactly alike, the 
ade distributions 


and the 
ould coincide, 
veterans would 


average nonvet- 
If veteran students are 


superior, the two distributions y 
coincide but will overlap, and t 


L1 Not significant 
E Ambiguous 


ans Excelling the 
ith Respect to Adjusted 
1 of Twenty-Five College 


ution 


А ‚ istrib 
portion of the veterans’ disti 


the 

Referring to Figure 5 we may ке ol 

two most extreme cases: 76 per Е pon 

Slightly the veterans excelled the average engi 

vill not veteran in adjusted grade in the mid 
hat pro- neering school of Midwest Tech (a 
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western land-grant college), while at the 
Opposite extreme only 39 per cent of the 
veterans excelled the average nonveteran 
at Turner (a private coeducational gini- 
versity). In the latter case the б d 
Were inferior to the nonveterans. М 
Veteran superiority in grades relative 
to ability is then not a universal tend- 
“псу. What about the over-all results? 
It will be observed that in 16 of the 20 
oe involving freshman students 
ЖОШ тан subgroup was япрапөг; опе 
aP о i by chance to find 16 out 
than ie: erences in one direction less 
VERTES umes in a hundred trials. This 
" in itself, being significant at the 
des cent level, may be considered as 
derately convincing evidence of su- 
m d of veteran students in academic 
eani, леп ability differences are kept 
ie Sing In the remaining four com- 
(ао А the nonveteraus were superior 
Lien. for liberal arts. students at 
nönvet m State the superiority of the 
im erans is too small to be apparent 
gure 5). 
m. the differences between. veterans 
in oraque speci statistically significant 
luba e the 20 college groups now 
dion занар! Evidence on this ques- 
ih К. shown by the shading of the bars 
ЫН an 5. The black bars indicate a 
сеў 3 à rada difference (the 1 per 
haie т el of confidence), the diagonally 
5 кч bars indicate significance at the 
ie (сш. level, and the white bars indi- 
the sults which are not significant at 
Бер per cent level. Bars outlined with 
the lines indicate that the results of 
oe test were ambiguous = 
to. th of technical considerations relatec 
Белү. fact that errors of estimate are 
б, er for one subgroup than for the 
ler) 


In three of the comp 


arisons, those for 


engineering students at Midwest Tech 
and Middle State and for liberal arts 
students at Central State who entered 
in 1946, the veterans are significantly 
superior (at the 1 per cent level) to non- 
veterans. In three additional compari- 
sons the differences are significant at 
the 5 per cent level. The remaining ten 
comparisons which showed ` =гегапѕ to 
be superior were either ambiguous or 
not significant (at the 5 per cent level). 
In none of the four cases where non- 
veterans were superior was the difference 
significant. 

On the whole, therefore, it must be 
concluded from the studies of freshman 
students that there is a tendency for vet- 
erans to achieve higher grades in relation 
to ability than do nonveteran students, 
but the magnitude of the difference is 
small. In the most extreme case, the ad- 
vantage ,of the veterans would on the 
average amount to no more than the 
difference between a "C" and a “C+.” 
In other institutions the difference was 
much smaller, and, as we have seen, the 
direction of the difference is even re- 
versed in some colleges. 

Now let us consider the remaining 
five comparisons—those involving “in- 
terrupted" veterans. Substantially all the 
veteran students in these five compari- 
sons were those who had completed at 
least two quarters of freshman work as 
ordinary civilians, who then entered 
military service, and who returned to 
college after discharge and completed at 
least an additional two quarters of aca- 
demic work. The nonveterans with 
whom the interrupted veterans were 
compared were ordinary civilian students 
who completed without interruption the 
same amount of academic work as the 
veterans. In three of the college groups 
these nonveterans were postwar students 
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who entered college as freshmen in 1945. 
büt at Midwest Tech they were prewar 
students who had entered in 1939. In 
all five of these groups, college grades 
earned early in a student's academic 
career were taken as the measure of his 
ability; those earned later in his college 
career were used as the measure of his 
academic success. For the veterans, of 
course, a considerable amount of time 
elapsed between their early and later 
academic work. 

In all five groups involving inter- 
rupted veterans, veteran students were 
superior to nonveterans of equal ability. 
In four of the five comparisons, the dif- 
ference in adjusted grade was significant 
at the 1 per cent level. The proportion 
of veterans who excelled the average non- 
veteran ranged from 72 per cent at East- 
ern City and Stewart to 57 per cent at 
the Midwest Tech engineering, school. 
The evidence from these studies of inter- 
rupted students thus strongly supports 
the hypothesis that veterans do excel 
nonveterans of equal ability with re. 
Spect to achievement in college. 

The interpretation of the differences 
found between veterans and nonveterans 
in these five groups is particularly diffi- 
cult. At first glance, it would appear that 
the veterans had gained greater maturity 
and a capacity for more intensive and 
prolonged effort during their absence 
from the campus; accordingly, they 
showed a marked gain over their initial 
performance—in contrast to the relative 
stability of performance shown by a non. 
veteran group whose careers w 
interrupted. Such an interpretation 
would overlook two important complica- 
tions: first, the possibility that shifts in 
grading standards over a period of time 
might influence the results; and second, 
the fact that in all five groups the vet. 


ere not 


erans earned lower freshman grades than 
did their nonveteran controls. The hypo- 
thesis that grading standards shifted is 
wediened by the fact that in three of p. 
groups the veterans were compared with 
a postwar nonveteran group (students 
entering in 1945) while in the other two 
the nonveteran comparison group was à 
prewar group (students entering in 1939): 
The advantage of the nonveterans in 
their freshman grades constitutes a more 
serious problem. Among the hypotheses 
which may be advanced to account S 
this finding, two appear to be mos 
plausible: first, the members of the vet 
eran group, realizing that their academic 
Careers were likely to be interrupted by 
War service, may have slackened ped 
efforts; and second, the necessary one 
sion from the comparisons of eer 
who continued their academic н 
in V-12 or ASTP may have removed к. 
disproportionate number of superior 
students, and thus lowered the dr 
in the remaining group. With her 
limitations in mind, it must be ior! 
nized that the findings are not as d 
clusive as the significance tests py a 
indicate. The findings, in spite ol А 
limitations, may properly be consider 
to favor the veteran group. , of 
In addition to the comparisons 
male veterans and male nonveteran” 
Study was made of a number of de t 
lems which were considered pertinen 
to the interpretation of the uw 
or which were by-products of the Pan 
Of analysis followed in making ere 
basic comparisons. These problems w 5; 
Studied in varying numbers of Ber 
no attempt was made, however, t? ple 
haust the possibilities of the availa 
raw data in seeking answers to them Sy 
One question, studied in three LM 
Was the possible significance of acade 
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load, as measured by the number of 
cedit hours carried. In all three in- 
Stances, it was found that veterans 
eae to take a slightly lighter Igad. 
ae м mcrely be a reflection didus 
сен ас veterans меге generally not 
quired to take physical education or 
жыка! science. It was also found that 
ations between work load and 
о of ability and college achieve- 
Whe es consistently positive—students 
iss А нда ще heavier load tend to get 
ency = ет grades in college. This tend- 
the brc: consistently found both for 
M теа subgroups and the nonvet- 
ПД Кз Oups. This finding tends to dis- 
ле hypothesis that veterans did 
fe. ASIE ofa reduced course load, 
"e г it does not provide an adequate 
tor rejecting 1t. 
ship rhe sangre to study the relation- 
een vee a the time when aptitude 
P n taken by veterans and the 
gs: ae they earned. In two institu- 
aminati here the College Entrance Ex- 
ion Board Scholastic Aptitude 
Bliss P» used, some veterans had ap- 
бг jm admission and were tested be- 
Wis ey for war service and some 
able big after discharge. This vari- 
all е te of testing, was correlated with 
achieve measures of ability and college 
to be ment. The correlations tended 
testin quite low, indicating that date of 
in he within the range encountered 
these studies, is of little importance. 
jus d is reassuring in the inter- 
of ite ae of the results, since in most 
after w car the veterans were tested 
Schoo] © service, several years after high- 
Were ser apne while the nonveterans 
ion fr Sted a few months after gradua- 
т" от high school. | 
А "Roa to inquire whether any 
ce in outcome of analyses of co- 


Predictors Used 
Per Cent of 
Veterans Ex- 
celling the 
Average Non- 
veteran 


A Test or Сош- 
bination of 
Tests without 
High School 
Standing 


High School 
Standing in 
Combination 
with а Test 
or Tests 


78 or higher 
73 to 77 
68 to 72 
63 to 67 
58 to 62 
53 to 57 


48 to 52 
43 to 47 
38 to 42 
33 to 5T 
28 to 32 
25 to 27 


22 or lower 


° Differelce significant at or beyond 5% level 


o Difference not significent 


X Outcome of analysis ambiguous 


_ сё с NEM AL LL 


Fic. 6. Distribution of Per Cent of Veterans 
Excelling the Average Nonveteran with Respect 
to Adjusted Average Grade for the Ten Groups 
in Which High-School Standing Was Used in 
Combination with a Test or Tests and for the 
Ten Groups in Which Tests Only Were Used 


variance is apparent in the groups for 
which both high-school standing and 
various test scores Were used as compared 
with those groups for which only test 
scores were used. As it happened, there 
were 10 groups of each type among the 
зо groups of entering freshmen. The 
general outcome of this comparison is 
shown in Figure 6. The median value of 
the percentage of veterans excelling the 
average nonveteran is 56 in both sets. 
However, the range in percentage of vet- 
erans excelling the average nonveteran 
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is 48 to 76 in the groups where high- 
school standing was used, and the range 
is 39 to 66 in the groups where tests 
alone were used. This suggests that the 
inclusion of high-school standing as a 
predictor is associated with findings 
which are slightly more favorable to the 
veteran group. 

Finally, attention was given to possi- 
ble trends in grades which veteran stu- 
dents earned in successive terms after 
war service. Examination of the mean 
grades of veterans and nonveterans shows 
no evidence that veterans were seriously 
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handicapped at the beginning of the col- 
lege work because of forgetting or de 
terioration of study skills, nor that there 
wà a period of initial enthusiasm which 
ж. ні marked temporary overachieve- 
ment. In four comparisons of this itype? 
no clear indication of a consistent se 
in differences of grades was found; 1 
forgetting does play a role in gua 
earned by veterans immediately и 
their entrance to college, it is apparent | 
counterbalanced by other factors such a 
a more enthusiastic approach to t 
study situation. 


28, 1952. 
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Allport-Vernon Test, “A Study of Values"* 
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Personnel Rescarch Section, AGO, Department of the Army 


I. INTRODUCTION 


oe its introduction, the Allport- 
Ernon test, A Study of Values, has at- 
tracted widespread interest among psy- 
chologists, A number of authors have 
reported the relations of the value scores 
ie n other and to other variables. Few, 
"^ e het concerned themselves with 
NOR ied accounting for the internal 
Psych oa among the test items. Many 
hate ogists would consider this latter 
the em basic to the determination of 
relationship between values and 
Other variables. If the measures em- 
oe overlap or intercorrelate con- 
lderably, confusion in the interpreta- 
d of values in relation. to other 
asures appears likely. It is the pur- 
cd of the present investigation to 
© oni the primary traits necessary 
бо Di for the intercorrelations of 
Musa of this test. Such an analysis 
жол. add to our understanding of per- 
рми values in general and have some 
ificance for the study of interest and 
Personality traits. 
m. manual accompanying the first 
айыт, of the test reported high corre- 
los шы several of the value scores, 
ы that these measures ем 
у not independent and that they 
аш 
ina t Opinions expressed are those of the 
Gia] or and do not necessarily reflect the offi- 
viewpoint of the Department of the Army. 
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presumably measure to a considerable 
extent common value tendencies. Since 
that time other investigators have veri- 
fied the correlation originally reported 
between these measures. Duffy and 
Crissy (2) reported the isolation of three 
factors from the correlations between 
the various value scores. However, the 
first and most extensive factor study of 
the Allport-Vernon test was that of Lurie 
(5). Lurig, being somewhat critical of 
the multiple-choice structure of the 
Allport-Vernon test items, constructed 
a similar test whose constituent items 
gave an indication of degree of evalua- 
tion without requiring a choice between 
several objects of evaluation. Twenty- 
four variables were employed in the 
analysis, each variable being the sum of 
several items. Of the seven factors neces- 
sary to account for the intercorrelations 
of these 24 variables, four were regarded 
by Lurie as meaningful. The six original 
evaluative types, namely the aesthetic, 
religious, social, economic, political, and 
theoretic, were reduced to four by the 
disappearance of the aesthetic evaluative 
dimension and the combination of the 
political and economic types. 


IL DESCRIPTION OF VARIABLES 

Basic to the construction of the All- 
port-Vernon test is Spranger's theory that 
men are best known through a study of 
their subjective values. Spranger pro- 
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posed a sixfold classification of such 
values as follows: the theoretical, the 
economic, the social, the political, and 
the religious. 

The test of values developed by All- 
port and Vernon (1) consists of a num- 
ber of questions based upon a variety 
of familiar situations, to which 9 alterna- 
tive answers (in Part I) and 4 alternative 
answers (in Part II) are provided. There 
are 120 alternative answers in all, 20 re- 
ferring to each of the six values. Subjects 
are instructed to mark the alternative 
answers in Part I according to degree of 
preference and to rank answers in Part 
II in order of their choices. 

Sample questions are given below with 
responses of a hypothetical subject. 

Part 1. Question т. 


The main object of scientific research should 


be the discovery of pure truth rather than its 
practical applications, 


(а) Yes (b) No 


Part II. Question 14. (Women have an alterna- 
tive form of this question.) 


If you should marry (or are married) do you 
prefer a wife who— 


4 а. сап achieve social prestige, 
manding admiratior 

1 0. likes to stay at 
house; 


com- 
n from others; 
home and keep 


ю 


c. is fundamentally spiritual їп her at- 
titude toward life; 


3 d. is gifted along artistic lines, 


It can be seen from the nature of the 
items that the test scores give the relative 
prominence of the several values types. 

Split-half reliabilities reported by the 
authors (7) range from -49 for the "so. 
cial" scale to .84 for the "aesthetic" and 
"religious" scales. Test-retest reliabilities 
range from .39 for the "social" 
-84 for the "aesthetic" scale. 

Although it was desired that the pre- 
sent study be as comprehensive as possi- 
ble, 30 possible variables were excluded 
from the analysis in order that compu- 


Scale to 
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tational labor might be kept within 
reasonable bounds. In the first section of 
30 items, where the subject is instructed 
to (choose between 2 alternative He 
men's or to accept or reject a sing’ 
statement, each item was considered : 
single variable. In the second sect р E 
4 alternative items, each alternative Б 
be considered a separate vor 
making a possible total of 6o variable 
for this section. In this latter section: 
the 4 alternatives of each item € 
forced negative intercorrelations. . je 
order to reduce such forced nega 
correlation to a minimum, the en 
alternatives of each 4 alternative a 
were discarded. The variables for its 
present analysis were thus confine Е 
the 30 items of Section 1, and to 30 of 
the бо item alternatives in Section ? 
the Allport-Vernon test. eit 
The variables are listed with. P 
numbering in the present analys ney 
with an indication of the value pu 
were designated as measuring 11 ^^ 
scoring key provided with the үн 
values. The letters А, В, E, Р, 5, mud 
are used to show the manner of one 
and are abbreviations for, respectiva y 
politica” 


ae ic, religi ic 
sthetic, religious, economic, 5, since 


social, or theoretic personal values: s 0 
the last go variables are alternative 
four-choice items which were t° 
ranked in order of preference, a 
alternatives must be shown in ОГО 
describe fully the variable. For eia ing 
one item in Part 11 calls for the ic? ts 
of four persons according to the rol ne 
interest in them. The ranking Puer 
9ne of these four persons consi e 
variable of the factor analysis. It 35 jnter 
as follows: “Florence Nightingale i ol 
6515 and attracts him more than Da 
eon, Henry Ford, or Charles Dm ow: 
this is listed as our item No. 55 иел 
The letters "S vs, р, E, T" followin8 


four 
er t° 


ple 
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= 55 indicate that choice of Florence 
ightingale was scored as social, while 
pe three alternative choices were scored, 
respectively, as political, economics or 
theoretic. 9 

E convenient in the factor analysis 
oes en sign of certain of the 
rent Я hen this was done, the state- 
Eon ica е variable was altered to con- 
E : e sign reversal. The reversed 
EG a the sample item given above 
Chatas T. : = apoleon, Henry Ford, or 
md arwin interests or attracts him 

an Florence Nightingale." 


b The variables of the analysis are listed 
elow: 


1. H 3 
tific oa believes that the main object of scien- 
truth e should be the discovery of pure 
T vs, E) jer than : its practical applications. 
2. H 1 "n XN 
Breat о на that it is justifiable for the 
and ap pet such as Beethoven to be selfish 
3. d igent of the feelings of others. (A vs. S) 
Жара not believe that because of the 
abolition and self-assertive nature of man, the 
4. It * of war is an illusory ideal. (R vs. Р) 
the ne he were a university professor and had 
Poetr cessary ability, he would prefer to teach 
Vs, т) rather than chemistry and physics. (A 


стеля prefer to teach economics rather 
6. н ae ie P) 
more ruber ees unselfishness and sympathy 
and а character traits than high ideals 
у енше eee 
Times h paper such as the New York Sunday 
ар ы interested in the section on 
and Uu eries than in the real-estate section 
8. He = Samet of the stock market. (A vs. E) 
analyzes A not think that a person who 
in his fe "n emotions is apt to be less sincere 
T ovs, S ing than one who is not so reflective. 
oe a prefer to read the headlines 
lon cant Leaders To Consult On Reconcilia- 
Машаны than “Great Improvements In 
10. H onditions." (R vs. E) р 
Cists x would prefer to read the story “Physi- 
ake Important Discoveries Concerning 


1 

ply e letters A, R, E, P, S, and T are em- 

Port. Vero indicate that the item is, in the All- 

Ure or ys test, scored, respectively, as а meas- 

cal, Soci esthetic, Religious, Economic, politi- 
cial, or Theoretic value. 


The Structure Of Atoms” rather than “Threat 
To Constitutional Government In Germany By 
A Dictator.” (T vs. P) 

Nu When he visits a cathedral, he is more 
impressed by the architectural features and 
stained glass than by a pervading sense of 
reverence and worship. (A vs. R) 

12. He does not believe that contemporary 
charitable policies should be curtailed because 
they tend to undermine individual initiative. 
(S vs. P) 

13. He believes tliat the evidence that has been 
impartially accumulated goes to show that the 
universe has evolved to its present state in 
accordance with mechanistic principles, so that 
there is no need to assume à first cause, cosmic 
purpose, or God behind it. (T vs. R) 

14. In. his opinion, general progress has been 
advanced more by the freeing of slaves with 
enhancement of the value placed on individual 
life rather than by the discovery of the steam 
engine with the consequent industrialization 
and economic rivalry in American and Euro- 
pean countries. (S vs. E) 

15. IE he had the opportunity, and if nothing 
of the kind existed in the community or col- 
lege where he lived, he would prefer to found 
a classical orchestra rather than a debating so- 
ciety. (A уз. P) 

16. At ай exposition he 
tific apparatus or chemical 
automobiles. (Т vs. E) 

17. Не would prefe 
popular lectures on the conter 
rather than the progress and 
service work in the cities of his p 
country. (A vs. S) 

18. He would prefer to hear a series of lec- 
tures on the comparative development of the 
great religious faiths rather than the compara- 
tive merits of the forms of government in Bri- 
tain and in the United States. (К vs. Р) 

19. If he had some time to spend in a waiting 
room, and there were only two magazines to 
choose from, he would read Arts and Decora- 
tions rather than The Scientific American. (A 
ys. T) 

20. He would encourage his children to have 
vocational training rather than to make several 


teams. (E УЗ. Р) 
21. He feels t 


prefers to see scien- 
products rather than 


r to hear à series of 
mporary painter 
needs of social- 
art of the 


hat the aim of the churches at 


the present time should be to bring out charit- 


able tendencies, and to urge people to think 
od of others, rather than to 


hip and a sense of com- 


dern industrial and 
pments are not signs of a 


degree of civilization and culture than 


greater 
previous race, such as the 


those attained by any 
Greeks. (A vs. E) 
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23. If he were waiting in a strange living 
room, he would be more apt to judge the 
owner's knowledge and intellectuality as shown 
by the books in his bookcases than his friendli- 
nes and hospitality as shown by the photo- 
graphs on the walls and the general comforts of 
the room. (T vs. S) 

24. He feels that the world would not be a 
much better place if we took to heart the 
teaching, "Lay not up for yourselves treasures 
upon earth . . . but lay up for yourselves treas- 
ures in heaven, where neither moth nor rust 
doth corrupt, and where thieves do not break 
through nor steal." (E vs, R) 

25. He is more interested in reading accounts 
of the lives and works of such men as Aristotle, 
Plato, and Socrates than of Alexander, Julius 
Caesar, and Charlemagne. (T vs. P) 

26. Taking the Bible as a whole, he would 
prefer to regard it from the point of view of 
its beautiful mythology and literary style rather 
than as a spiritual revelation. (A vs. R) 

27. He does not believe that since the class 
Or social status to which a man belongs de- 
pends mainly upon his push and ability, it is 
just that a small proportion of the population 
should be very rich. (S vs. P) 

28. If he were to choose a topic on which to 
write an essay, he would choose the defects of 
our present educational Systems rather than the 
role of church-going in religion. (Т уз. R) 

29. If he were to choose a topic on which to 
write an essay, he would prefer the personality 
of some close friend of his rather than the 
necessities of life, luxuries, and savings. ($ ys, Е) 

30. When witnessing a gorgeous ceremony 
(ecclesiastical or academic, induction into office, 
etc.) he is more impressed by the color and 
pageantry of the occasion itself rather than by 


the unified idea or institution which the group 
represents. (A vs, p) 


among nations, (S vs, Е, p, R) ° 

32. He believes that good government should 
aim at more aid for the poor, sick, and old, the 
introduction of more ethical Principles into its 
policies and diplomacy, or the establishment of 
à position of prestige and respect among ma. 
tions; rather than the development of manu- 
facturing and trade. (S, P, R vs, E) 

33. He believes that 
business for his living 
spend Sunday in tryin 
reading serious books; 
win at golf or racing, 


а тап who works in 
all the week сап best 
& to educate himself b 
rather than by trying to 
going to an orchestral 


concert, or hearing a really good sermon. (Т УЗ. 
P, R, A Я 
РУ СА believes that а тап who ee 
business all weck can best spend Sunday p 
ing {о educate himself by reading сара с 
going to an orchestral concert, or iy td 
really: good sermon; rather than by try 
win at golf or racing. (R, A, T vs. P) i ational 
35. Ш he could influence the ced Y d 
policies of the public schools of some Pate 
would undertake to promote the study E velop 
performance of drama; rather than to m pro- 
cooperativeness and the spirit of service, s P: 
vide additional laboratory facilities, oe E a in 
mote school savings banks for educatio: 
thrift. (A vs. T, E, S ч li- 
36. 1 he could аә the айкай! Por 
cies of the public schools, he would pe б 
to promote the study and the pero nisi 
the drama, to provide additional os for 
facilities, to promote school savings pa lop co 
education in thrift; rather than to nan E D 
operativeness and the spirit of service. (A, 
vs. S) . EH 
37. He would prefer a friend of k 
sex who is seriously interested in thin 
his atttiude toward life as a whole, Т 
possesses qualities of leadership and оа іопа 
ability, one who shows refinement and Өл (ficient 
sensitivity; rather than one who is f mind: 
industrious, and of a practical turn О: : 
(S, P, R vs. E) +. OW 
38. He would prefer a friend of his 


in 


his own 


ing out 
ne who 


n sex 


is 
LM «thinking ОШ ! 

who is Seriously interested in ening an one 
attitude toward life as a whole; rather ctical 


n + + H pra 
who is efficient, industrious, and of a F 


теб Ol 
n а alitics 

turn of mind, one who possesses en who 

leadership and organizing ability, OT (К 


shows refinement and emotional sensitivity: 
vs. S, P, E) 1 
39- If he lived in a small town and ^ 
than enough income for his nceds, ra 
Prefer to use it to endow the church t "m 
he belonged, give it to a university 
development of scientific research, odu 
to hospitals; rather than apply it Re 0 
to industrial development. (T, S, R 17 ad more 
40. If he lived in a small town and re would 
than enough income for his needs, нем 
Prefer to apply it productively to in 
velopment, give it to a university fo te it {б 
velopment of scientific research, devo ov ШР 
hospitals; rather than use it to y 
church to which he belongs. (T, 5, E peo enjoys 
41. When he goes to the theatre, П шау 
most, as а rule, the ballet or similar pm 
performances, plays with a theme nem argue 
suffering and love, problem plays (32 sathe" 
Consistently for some point of m me 
than plays that treat the lives of В! 
(T, A, $ vs, Р) 


vote | 
le tively 


> — 
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42. When he goes to the theatre, he enjoys 
Most, as a rule, ballet or similar imaginative 
eee rather than plays that treat the 
ms great men, plays with a theme of human 
uiri. 8 and love, or problem plays that argue 

nsistently for some point of view. (A $ Т, 


S, P) 9 
“ees that he had the necessary ability 
occupatio the Пату for each of the following 
a i ns was the same, he would prefer 
ШАНДЫН ШЫННАН; rather than а sales 
ager, рү ici Ta E 
R p ergyman, or politician. (T vs. E, 
ud lec that he had the necessary ability 
occupatio the salary for cach of the following 
© n ns. was the same, he would prefer to 
father gre thematician, clergyman, politician; 
: lan a sales manager. (T, R, P vs. E) 
macte i had unlimited leisure and money, 
sculptures prefer to make a collection of fine 
mier] ps paintings; rather than establish a 
malántu hygiene clinic for taking care of the 
н т апа mentally deficient, aim at a 
into ens Or a seat in the Cabinet, or enter 
s anking and high finance. (A vs. S, P, E) 
he 5 к һаа unlimited leisure and money, 
clinic Se prefer to establish a mental hygiene 
mental} т soning care of the maladjusted and 
or к eficient; rather than make a collec- 
Sihatorghin с sculptures or paintings, aim at à 
into ne Ip or a scat in the Cabinet, or enter 
x anking and high finance. (S vs. A, P, E) 
ion {үрер discussion with intimate 
When » his own sex, he is most interested 
chology T talk about philosophy and psy- 
Чор. 8) » literature, socialism and social ameliora- 
^ rather than the meaning of life. (T, A, S 
M EE _evening discussion with | intimate 
When d his own sex, he is most interested 
cholos Dey talk about philosophy and psy- 
ture d rather than the meaning of life, litera- 
A. r socialism and social amelioration. (T vs. 
> S, R) 
een МЫНЕ his next summer vacation he 
lologi prefer to write and publish an original 
some” о essay or article; rather than stay in 
Poi sec uded part of the country where he 
tennis appreciate fine scenery, go in for a local 
°хретїе or other athletic tournament, or get 
E nce in some new line of business. (T vs- 
» A, p) 
ро During his next summer vacation he would 
counts to stay in some secluded part of mie 
rather" тае he could appreciate fine scenery; 
bioloz; than write and publish an original 
toni d essay or article, go in for a local 
exper} or other athletic tournament, or get 
SE m in some new line of business. (A vs. 
51. Great exploits and adventures of discovery 


such as Lindbergh's and Byrd's seem significant 
because they add to our knowledge of mechan- 
ics, geography, meteorology, etc., because they 
weld human interests and international feel- 
ings throughout the world, or because they 
contribute to the ultimate revelation of the 
meaning of the universe; rather than because 
they represent conquests by man over the diffi- 
cult forces of nature. (T,.S, R vs. P) 

52. Great exploits and adventures of dis- 
covery such as Lindbergh’s and Byrd’s seem 
significant to him because they add to our 
knowledge of mechanics, geography, meteorology, 
etc; rather than because they represent con- 
quests by man over the difficult forces of nature, 
because they weld human interests and inter- 
national feelings throughout the world, or be- 
cause they contribute to the ultimate revelation 
of the meaning of the universe. (T vs. S, R, P) 

53. He believes that one should guide one's 
conduct according to, or develop one's chief 
loyalties toward, one's ideals of beauty, one's 
business organizations and associates, society as 
a whole; rather than toward one's religious 
faith. (A, E, S vs. R) 

54. He believes that one should guide one's 
conduct according to, or develop one's chief 
loyalties toward, one's ideals of beauty; rather 
than one's religious faith, one's business organi- 
zations ат associates, or society as a whole. 
(A vs. E, S, R) 

55. Florence Nightingale interests and attracts 
him more than Napoleon, Henry Ford, or 
Charles Darwin. (S vs. P, E, T) 

56. Florence Nightingale, Henry Ford, or 
Charles Darwin interests and attracts him more 
than Napoleon. (S, E, T vs. P) 

57. He would prefer, if he were to marry, a 
wife. who would like to stay at home and keep 
house, one who is fundamentally spiritual in 
her attitude toward life, one who is gifted along 
artistic lines; rather than one who can achieve 
social prestige commanding admiration from 
others. (A, S, R vs. P) 

58. He would prefer, if he were to marry, a 
wife who could achieve social prestige com- 
ation from others, one who is 
tual in her attitude toward 
d along artistic lines; rather 
at home and keep 


manding admir: 
fundamentally spi 
life, one who is gifte 
than one who likes to stay 


house. (A, R, P vs. S) 
He would like to think of Leonardo da 


“The Last Supper" as one of the most 
priceless and irreplaccable pictures ever painted, 
in relation to Leonardo's versatility and its place 
in history, as a masterpiece of design; rather 
than as one expressing the highest spiritual 
tendencies and emotions. (E, T, A vs. R) 

Go. He would like to think of Leonardo da 
vinci's picture ""The Last Supper" as expressing 
the highest spiritual tendencies and emotions, in 


2: 
Vinci's 
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relation to Leonardo's versatility and its place 
in history, as a masterpiece of design; rather 
than as one of the most priceless and irre- 
placeable pictures ever painted. (R, T, A vs. E) 


Ill. POPULATION 


The subjects of the present study 
were 200 male students of the University 
of Illinois. The limitation to one sex 
was imposed because of the probability 
that males would differ from females not 
only in the magnitude of their evalua- 

_ tive tendencies but also in the interrela- 
tions of such tendencies. The test papers 
used were those of students who had 
been tested in 1936 and 1937 as a part of 
a regular class exercise during a course in 
social psychology. 


IV. PROCEDURE 


Tetrachoric intercorrelations between 
each of the 60 variables were computed 
and the resulting matrix subjected to a 
centroid analysis. After the extraction of 
eleven centroid factors, the residuals 
were symmetrically distributed and had 
a standard deviation of .o8. This may be 
compared with the standard error of 
-11 of a tetrachoric correlation of zero 
with a median split of both variables. 
Rotation of the centroid factors to an 
oblique simple structure was next ac- 
complished. 

The intercorrelations of the 
traits were then determined. 
number of these correlations a 
significantly high, the matrix fo 
variables 


primary 
Since a 
ppeared 
; rmed by 
s involved in such significant 
correlations was factored and the result- 
Ing centroid factors rotated orthogonally 
into a simple structure. Factors ПІ, IX 
and X were excluded from this analysis 
for the reason just mentioned, that is 
their correlations with other primary 
traits were quite low. Factor XI 


i Was also 
not included since it is residual in nature 


Loadings of the бо original variables on 
these second-order factors were then 
calculated. 

Ingarriving at the general factor solu- 
tion presented as Table 6, a number at 
alternatives. were investigated and dis- 
carded as being less meaningful than ^ 
one here presented. Throughout the in- 
vestigation of these alternative solutions: 
the factor pattern showed little change 
with respect to variables with loadings 
above .4. Variables with loadings b 
tween .2 and .4 could be made to bui 
above and below the arbitrary level 0 
significance, namely .30. This jack p 
rigidity in the simple structure is eviden 
in the literature on factor analyses Y 
nearly all fields other than abilities: 
effect will probably be greatest in lo? 
ings on the second-order factors. 


Since the reader may feel, in cons 
some of the following discussion of the inc to 
ual primary traits, that an undue amoun 
detailed discussion is devoted to the T 
between individual variables and the Р 
traits of this and Lurie’s analysis, the 7 
for this emphasis will be indicated. Th amar’ 
believes that the identification of а Р st 
trait is an extremely tentative process 2 Пар! 
with limited information at present ane two 
and even more so that the identification 2 Ses 
primary traits emerging from different. ^y 076 
as identical must depend upon something 
than similarity between names attache has 
Measures subjected to factor analysis- 
been shown a number of times that que. 
naires purporting to measure the Same аг 
intercorrelate negligibly, А detaiied comp: actors 
of variables with high loadings on Ше pefore 
in question is, consequently, desirable rity of 
statements regarding identity or simia 
factors are made. the 

From each of the columns of Table jables 
Primary-trait matrix, a list of those V7" pre- 
with loadings greater than .go has RT ne: 
pared. These are the basic definitions 0 с, Wi 
ture of each factor. In the present instance, © jn 


yimary 


: by examining these н ple 
writer has, however, attempted tOo 7 jn 
all evidence which may be of aid in ths whic” 
pretation and to develop those hypothese* 


EE eee 
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зеет to him most fruitful. Because of the dif- 
ficulty in selecting a single word which conveys 
exactly the meanings necessary to define the 
configuration of loadings, the significance of the 
BE Ee eae eus factors should be gnini- 
nized. Names will be employed as symbols refer- 
ring to the list of traits or to hypotheses con- 
cerning these lists. 


V. RESULTS 
A. GENERAL 


The centroid matrix is presented as 
Table I; the transformation from the 
centroid to. the primary-trait matrix as 
Table 2; the cosines between the perpen- 
diculars to the hyperplanes defining the 
primary traits as Table 3; the correla- 
tions between the factors as Table 4; 
the loadings of the first order on the sec- 
ond order factors as Table 5; and the 
loadings of the variables on the primary 
traits as Table 6. Table 6 includes the 
loadings of the variables on the second- 
order factors, A, B, and C. The variables 
of the analysis are designated by arabic 
numbering, rotated factors by roman 
numerals, and the centroid factors by 
roman numerals with the prime symbol. 


B. Tue FIRST-ORDER FACTORS 
Factor I: General Aesthetic Interest 


oo 17. Loading, .66. He would prefer 
teen car a series of popular lectures on the con- 
Er painter rather than on the progress 
of hi needs of social-service work in the cities 
is part of the country. 

T. siat 45. Loading, .66. If he had unlimited 
Pi and money, he would prefer to make a 
eS ee of fine sculptures or paintings; rather 
Pus to establish a mental hygiene clinic for 
ДЕРДЕ care of the maladjusted and mentally 
C cient, aim at a senatorship or a seat In the 
abinet, or enter into banking and high finance. 
Nilesh 18. Loading, бо. He would prefer to 
feve a series of lectures On the comparative 
than opment of the great religious faiths rather 
п on the comparative merits of the forms of 
Bovernment in Britain and in the United States. 
t Variable 36. Loading, .54- If he could influence 
s educational policies of the public schools, 
th Would undertake to promote the study and 
© performance of the drama, to provide ad- 


ditional laboratory facilities, to promote school 
savings banks for education in thrift, rather 
than to develop cooperativeness and the spirit of 
service. 

Variable 35. Loading, .50. If he could influence 
the educational policies of the public schools 
of some city, he would undertake to promote 
the study and the performance of drama; rather 
than to develop cooperativeness and the spirit of 
service, to provide additional laboratory facili- 
ties, or to promote school savings banks for 
education in thrift. 

Variable 50. Loading, .49. During his next 
summer vacation he would prefer to stay in 
some secluded part of the country where he 
could appreciate fine scenery; rather than to 
write and publish an original biological essay 
or article, go in for a local tennis or other 
athletic tournament, or get experience in some 
new line of business. 

Variable 19. Loading, -49. If he had some time 
to spend in a waiting room and there were 
only two magazines to choose from, he would 
read Arts and Decorations rather than The 
Scientific American. 

Variable 29. Loading, .42. If he were to choose 
a topic on which to write an essay, he would 
prefer the personality of some close friend of 
his rather, than the necessities of life, luxuries, 


and savings. 


Variable 57. Loading, .42- He would prefer, 


if he were to marry, а wife who would like to 
stay at home and keep house, one who is funda- 
mentally spiritual in her attitude toward life, 
one who is gifted along artistic lines; rather 
than one who can achieve social prestige com- 
manding admiration from others. 

Variable 42. Loading, .36. When he goes to 
the theatre, he enjoys most, as a rule, ballet or 
similar imaginative performances; rather than 
plays that treat the lives of great men, plays 
with a theme of human suffering and love, or 
problem plays that argue consistently for some 

oint of view. ) 

Variable 4. Loading. -33- If he were a university 
professor and had the necessary ability, he would 
prefer to teach poetry rather than chemistry 
and physics. 

Variable 41. Loading, .33- When he goes to 
the theatre, he enjoys most, as a rule, the ballet 
or similar imaginative performances, plays with 
a theme of human suffering and love, problem 
plays that argue consistently for some point of 
view; rather than plays that treat the lives of 

reat men. 

Variable 54. Loading, .33- Не believes that 
one should guide one’s conduct according to, 
or develop one’s chief loyalties toward, one’s 
jdeals of beauty; rather than one’s religious 
faith, one’s business organizations and associ- 


ates, or society as a whole. 


Tue CENTROID MarRIX* 


TABLE 1 


Vari- 7 7 ; 4 ў 4 х XI 
able 1 Il IH IV V VI E ҮШ ІХ 2 
1 097 —064 —123 067 113 107 —184 079 141 158 THO 
2 281 —135 —226 —181 221 255 —239 136 —077 O51 —098 
3 363 ооз 195 0539 —182 обт —096 оз: — 407 271 — 255 
4 268 —410 —258 —1601 —164 —308 —256 143 —286 о8о тор 
5 II4 125 117 —073 263 155 —040 —o64 —134 og4 —182 
6 132 261 —262 038 —163 246 285 —175 140 —207 — 339 
7 349 —312 082 —237 —298 237 —261 —o88 135 224 055 
8 233 056 028 —212 —180 —174 207 036 183 —o;9 —001 
9 164 —474 248 —268 —317 193 —153 —065 одд — 283 ХОЯ 
то 073 273 343 —074 229 222 334 —227 обо 059 ДО 
I1 186 422  —240 —136 -—2o0 -—o:8 —039 120 —124 —102 241 
12 307 -—119 —065 271  —396 275 обо 208 —ogo —107 295 
5 — 283 254 222 o2 —23 312 —181 —212 —02 
13 225 412 8 6 33 3 028 
GS Lh 00 m ccs is obo фр сю Cms ой 
16 446 245 251 ЕЯ 205 518 tn 18 ec 168 
4 2 5 e 5 7 025 131 131 —225 
17 517 —063 —076 —541 302 7 O45 б 5 og8 —207 
18 334—442 376 —389 — 092 —or4 туз E Pm 
19 285 —430 —288 067 —133 —259 —089 -—110 C—o89 134 — 327 
20 143 052 020 098 —073 щі 057 093 170 oj4 —297 
21 251 5бо —132 —032 — 408 295 139 134 256 —038 —166 
22 358 —134 —178 083 021 138 —207 107 174 —082 054 
23 420 089 —о44 —223 052 —158 —о, 8 063 
24 184 438 —231 -—o8 5 du Tr d 137 m 
4 ned 3 3 9 о5о 208 —173 —262 —130 —081 199 
25 565 053 297 198 211 —248 —005 108 —18o —о27 —082 
2 200 E =2259 037 220 997 — 189 102 —101  —079 115 
1 40 14! 033 E —202 053 —088 086 188 Igs4 —117 
а E 483 —204 062^ —157 102 —192 —o44 115 179 122 
E 256 E e =e —015 —228 286 158 —133 —156 —186 
зт $44 — 144 — 089 296 -230 4008 103 —101 —127 — 154 267 
32 242 —418 105 иј — E —988 сї —1п 89 ор 007 
33 302 —о7д 128 здү ESI E. 176 —109 o12 оў? d 
34 348 —334 323 213 122 En Оа. 229 e 131 
"AE ТЫК 07 ай ш. OA m M б ш 
3 157 —549 = = z =1ī49 —238 —o5 096 
Чо s cx asa do mb cass ош Ty 798 шю 1 
38 442 —143 — 123 — 446 ae CI 130 220 —105 ооб E 
39 378 —275 2 = — 259 208 саа шт A 
40 доз 500 48 109 тр 174 —18: —i4o 129 —106 291 
fa 538 оо —о0б tgr 1592 . 995 138 —i44 1з оз 124 
pa 412 250 —oSo —15 143 су 144 —135 —o92 040 э, 
ад — 362 1258 120 209 166 WE ma бе. би. NO. 502 
а 066 207 A AB me — e LS > шш a 
46 — 434 108 — 446 í я °97 —119 —ogs oat 046 o34 210 
47 449 ою — 33 о) отд ma = 129 
48 ogo 260 215 818. =ош —142 E "ES A - 149 
21 -i = ша. 41 281 161 2 
2 F 136 156 902 182 = E 350 162—226 145 
130 —414 ~—2 =“ —1$ o8s " 230 
51 235 209 358 aie о7о 122 озб E ps ed —147 
cm : 986 —i8, = ae 2 —o01; —05 
39 173 255 116 —ф 3 979 —обо 188 106. 70) 
53 105 668 —544 TTP 3 7102 —036 —250 208 287 070 
54 750 —os8 —14 161 Top me ca 131 
95 йл =ar ae 970 Фо 139 nj 213 —ошз збо 184 
50 — 270 одо 488 07 “эю o6 is Me m —034 
3? 388 =516 =k $83 338 aos ..,29 217 од =з] ee 
OE E 4 182 тур =o 99 =tio =—252 300 8 
ЫЗ (Ta —1i44 nis "007 =tio? 9150 тӘ 88. 35 
59 350 456 — 5 228 2 54 
A IS 999 295 „чур Bs 190 220 — 332 222 2 
4 169—279 336 "UC ae 138 —064 —тоо тті 043 
tme 110 o8o 211 20; — 269 —114 
mals prop 
жж 


Communality, 


erly Preceding each entry have been omitted 
ed. 
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TABLE 2 
THE TRANSFORMATION MATRIX* 
гт м 

| I Il Ill IV в V VI уп VIII IX х XI 
jh 403 325 o86 312 265 174 054 264 239 —016 255 
Ш, —338 —103 -—194 341 332 — 230 159 —263 384 —062 057 
Iv —343 —037 озо —532 466  —047 510 —045 158 —215 117 
у; —5364 —137 —200 —02$ 207 286 —оо 526  —22 126 —032 
vb 013 185 268 —074 —075 —520 375 0o42 —289 28) —455 
үп, —158 476 —251 —o6r —186 262 568 —o14 —365 —477 —018 
ҮШ, 244 —658 —227 —047 —401 —1]3 189 526 —003 007 130 
Ix: —241 219 —312 —4бо —145 —366 o38 463 550 —305 —403 
НЯ —027 зоо —347 —215 —308 обо 320 080 328 649 424 
s o25 056 301 —230 —153 —304 —043 160 —204 -—318 580 
3 — 380 173 648 оог —317 409 320 238 227 —092 —047 


* i" Д л 
Decimals properly preceding each entry have been omitted. 


All but four of the aesthetic variables 
(on the original scale of values) are 
Significantly loaded on Factor I. Conse- 
quently, Factor I may be regarded with 
Considerable confidence as aesthetic in 
Nature, 

Variables 2, 7, 15, and 26 purport 
о Measure aesthetic evaluative tenden- 
“les but are not loaded on Factor I. Since 
the loading of Variables 2, 7, and 15 
SS from Table 1, .246, .281, and .214, 
"spectively, it would appear that their 
Absence from the above listing can be 
plausibly attributed to sampling error. 
The loading of —.o21 of Variable 26 
does indicate some discrepancy between 
the content of Factor I and aesthetic 
valuation as conceived by the authors 


of the test. 

Variables 18 and 29 are loaded on 
Factor I although they apparently lack 
aesthetic content. Subjectively, however, 
they appear to reveal emotional or ap- 
preciative tendencies which might be 
expected in persons aesthetically in- 
clined. Variables 36 and 57 while not 
primarily aesthetic have, respectively, as 
an alternate choice "teaching drama" 
and "choosing a wife gifted along artistic 
lines." These alternatives were assumed 
to be adequate explanation of their 
loading on Factor I. 


The absence of a clearly defined aesthetic 
factor in Lurie's results is difficult to explain. 
In order that this problem may be more closely 
analyzed, each of the variables of Lurie's analysis 
which were intended as measures of an aesthetic 


TABLE 3 
Tue CosixE MarRIX* 
I Il Ill IV у VI ҮП УШ IX X XI 

I ; = 6 arg —147 —165 —329 —146 —113 150 236 
П ас т се E E о21 180 359 —125 084 —003 —037 
И R 1.000 обт —005 064 —021 —107 —188 —113 ооо 
ү 1.000 230 220 —317 -—349 —027 1560 033 
у 1.000 033 -—145 —388 068 —1$2 —о6$ 
VI 1.000 030 от —062 одо 160 
VIT 1.000 166 osi —007 ото 
VIII 1.000 I31 — 051 o18 
IX 1.000 одо 033 
X 1.000 057 
XI 1.000 


* ү 
Decimals properly preceding each entry have been omitted. 
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TABLE 4 
THE INTERCORRELATIONS OF THE Primary Factors* w 
c X XI 
II ш IV V VI gi VIII IX = х ^ 
— of — 298 
I | —116 -—oor —186 233 277 412 o88 зда a 198 
II —I13 149  —002  —253  —357 225 sag? є 088 
ш —oso 054 —024 042 o61 165 us обт 
IV —139 —302 142 262 —ob4 E- E 
V 014 137 367  —119 zu 2280 
VI 068 —128 138 004 “ш 
VII —059 032 017 254 
— 180 102 ane 
VIII ew 
n oot 
x 
* Decimals properly preceding each entry have been omitted. А 
— sire tO 
primary trait, namely, Variables 9, 10, 11, and interested in beautiful things; and des 


12 will be discussed in relation to the variables 
in the present analysis. 

Variable 9 in Lurie's analysis is the sum of the 
scores on the following items: desire to teach 
modern poetry, to read about art, to read the 
Saturday Review, to have one's son spend his 
spare time in joining a poetry society, to endow 
a symphony orchestra, and to listen to a lecture 
on architecture in relation to the other arts. 
These various component items might be re- 
lated to Variables 4, 19, 15, and 47 of the 
present study although interest in literature as 
well as interest in other phases of art is indi- 
cated in Variable 9. This variable would prob- 
ably be loaded on Factor I if it had been in- 
cluded in the present analysis. The com 
items in Variable ro of Lurie's a 
follows: 


ponent 


nalysis are as 
liking for the occupations of musician 


or portrait painter, tendency to encourage his 
child to seek a career in literature, and desire 
to be considered a connoisseur and artistic and 
talented. No variables in the present an: 


alysis 
resemble any of the items comprising Variable 
10. Variable rr of Lurie's analysis consists of 


the following items: 
Beethoven, Homer, an 
liking for the comp: 


interest in Michelangelo, 
d Edna St.Vincent Millay; 
any of people who are 


LOADIN 


мес. 
marry someone who is sensitive and bero 
Here again no variables of the p items. 
closely resemble any of these compon n of the 
Variable 12 of Lurie's analysis is the n eal i: 
scores of the following items: belief pour 
research should try to make the pe people 
beautiful, that education should tea ynment 
to be alive to beauty, that good 80 rumen! 
should foster the arts, that a good ih t 
against war is that it is dirty and pb adit in 
a white-collar worker should spend 
attending museums and concerts, that s 
needs to replace the ugliness in the WOY 
beauty. Since Variable 12 contains no СО tor 
Which resemble variables high upon Тасо деп 
since, also, it appears to involve “aa с that 
toward social reform, it is understan aestheti 
this variable will not correlate with an 
factor, 


en 
petwe' 
In spite of the absence of resemblance 


nd !! 
individual items, Lurie’s Variables Ps game 
appear subjectively to measure much variables 
attributes which are measured by es y the 
high upon Factor I except, possib ШУ hich Ё 
Occupational emphasis їп Variable a main 
not apparent in Factor I. If it cou stheti 


& ^ А ings а 
tained that persons interested in thing 


TABLE ; 


G OF THE PRIMARY TRAITS ox THE SECOND-ORDER GENERAL FACTORS 
(AFTER Roration)* 


Primary Trait 


C 
а MEE 
I Aesthetic Evaluative T y т 
Ш ШЧ in Fine Arts tos ted 498 в 
ntireligious Evaluativ = e 
a Antiaggression үш ES E p 
umanitarian Evaluativ 1 
VIL Interest in Science a der xd ni 
VIII Liberalism sir be Y 
—245 
* Decimals properly Preceding each entry have been omitted 


a ee 
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ТАВГЕ 6 
Tue Rotate FACTORIAL MaTRIX* 


Variable 1 i| "nur iw т a vir vir Іх х х 
x —075 3190 112 =o - 
2 50 105 036 o8: о 
5 240 451 обу об: —о28 2—085 S eee 
д 126 oia 009 074 462 —o89 —144 029 

5 385 = ni 366 024 org одї —522 049 о5б III —070 
ё o84 006 ото об 1950 —209 158 134 °—154 —ПО —067 
" 197 —148 —500 дот —051 112 —оп -—034 —049 128 140 
8 ES 364 238 —063 093 276 —о33 —110 —098 —371 291 
9 286 —107 -—137 072 —047 —013 —044 Toy 326 131 204 
Xo 200, 290 078 —234 —023 Sol їїй —113 06; —o89, 065 
HY 031 —o8o o66 org —or4 —083 554 ors —038 —056 161 
no mc озо 043 435 052 og8 —004 —066 363 —150 —039 
13 LUI 143  —129 017 —029 471 029 389 124 —301 044 
14 232 210 —134 376 273 —096 —o63 071 186 —o29 —418 
ЯН о7о о22 —o24 —305 —048 076 oso 409 127 —414 158 
16 214 322 —086 003 073  —020 is: —244 —267 —035 187 
17 бо зоо 044 136 одо —043 403 020 371 055 —103 
18 * A 372 —017 066 —004 —324 161 —103 озо 044 102 
19 5р —005 одо — 210 158 —051 обу —о8т —об7 —обд —067 
25 486  —osr 027 076 046 озу —558 076 —216 І 167 
21 us 0607 —343 —044 o43 —064 oso ооо o2 oor 170 
аа EU o82 —550 350 037 098 114 —002 309 —119 319 
23 E 425 —OST озб —034 195 038 163 109 074 —023 
24 207 190 079 162 047 —042 oo8 oro 334 133 о8І 
25 022 —007 276 боб 223 004 —I55 —287 133 124 ооо 
4d 989 078 118 040 sos —108 020 199 175 -—000  —oór 
27 O21 343 055 578 273 —033 тот ооо 259 —051 —124 
28 ооо 201 -—191 —040 112 237 —063 368 o32 036 300 
29 —162 о8о 022 419 078 оз] —156 -—119 230 o62 224 
30 420 —187 —o7o —083 166 —182 —016 127 277 —055 —020 
EM 122 —o80 101 291 —098 209 ost —147 —o40 —202 049 
32 197 —о4ї 065 212 118 343 —170 354 or2 —0ооб 252 
33 097 —018 102 —217 —099 448 обі 329 —065 —159 330 
34 E —OSI 137 —039 —097 оо8 287 378 —029 525 205 
35 ото 193 озб —425 —053 065 338 518 076 —054 065 
36 502 157 444 377 —о8о 22 —362 —085 ost 113 235 
37 538 071 370 092 —449 —070 —064 —074 ,—944 420 321 
38 287; —оог —042 o62 o82 —149 -—190 44 8 oso 045 —907 
3o =en —189 —035 —06$ 054 073 122 683 087 oos —158 
4o 017 353 172 115 144 - 542 282 o86 057 oor 130 
4I 049 oo8 ost 753 034 —021 003 066 043 oor 053 
42 329 тоб —069 299 204 104 —202 20, —оо$ 035 252 
43 _ 358 —os3 245 334 11б —276 —063 -—02 —o16  —o79 302 
44 079 441 o48 078 20. одо 237 от ооз о7о 202 
45 209 318 323 —006 1$ 078 049 246 —064 —065 170 
46 622 246 оўо —006 142 —079 —057 064 083 073 165 
47 —o33 —o13 —012 одо 374 322 31 119 тот —100 046 
48 199 428 о54 —048 —008 —088 —02 158 'sór OII 172 
49 134 109 -—072 —053 16r —063 o86 —073 642 об —r1o 
5o 008 190° 137 —029 o98 —121 231 433 422 —017 055 
51 493 115 063 020 —217 062 —123 —004 —281 обо —005 
52 —033 —оод —067 —036 347 —022 057 —015 257 039 4її 
33 —o82 —018 092 O21 180 096 106 —016 o87 обі 498 
34 064 -—o43 Ol 776 —oós —034 024 —035 —o54 оз 024 
55 325 217 349 296 обт о7ї 112 344 —12 —182 обо 
36 062 —023 075 —023 489 479 -—073 —00ї —o87; —045 —028 
57 —139 1030 007 046 714 обо 128 —обт —048 о23 —228 
58 419 149 —082 044 oso 283 —188 100 224 459 — 007 
5 132  —o82 452 —239 —023 —299 075 зот тоз —240 —127 
ЕЧ 230 -—o41 —006 424 123 -—133 —015 —099 210 —184 260 
—024* oos —265 -—031 —170 оо —o8r зат 014 394 —282 


ж &, 
Decimals properly preceding each entr: 


aoe no more likely than other individuals to 
of ie these occupational preferences, Factor VII 
SEIS analysis? which heavily involves both 
te. iable g and Variable 11, would bear some 

Semblance to Factor I and could plausibly 
MCA as an aesthetic factor. If the pri- 
ex [күре in these two factors were 
шеа in terms of the traditions of those 

ividuals who have leisure to enjoy the 
~ 


WR ce, Y ч " 
as Lurie interprets Factor VII of his analysis 
ў ота а sort of lip service to aesthetic 

alues. He does not regard Factor УП as well 


defined or as well established. 


у have been omitted. 


various forms of art, this possibility would ap- 
pear much more reasonable. Undoubtedly, aes- 
thetic appreciation is associated with the есо- 
nomic standards and leisure of the professional 
and upper middle classes, whether this is due 
to the traditions and training of these social 
classes, to their greater opportunity, or whether 
it must be explained in some other way. 


In summary, then, it may be said that 
Factor I is undoubtedly aesthetic and 


that it apparently follows rather closely 
the content intended by the authors of 
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the test. It will become evident in discus- 
sion of Factor II, however, that a con- 
siderable proportion of variance of aes- 
thetic variables is not accounted for by 
Factor I. General Aesthetic Interest will 
serve as a convenient designation for 
Factor І. А 
Factor П: Interest in the Fine Arts 


Variable 2. Loading, .45. He believes that it 
is justifiable for the great artists such as Beetho- 
ven to be selfish and negligent of the feelings 
of others. 

Variable 43. Loading, .44. Assuming that he 
had the necessary ability and that the salary 
for each of the following occupations was the 
same, he would prefer to be a mathematician, 
rather than a sales manager, clergyman, or 
politician. 

Variable 47. Loading, 43. At an evening dis- 
cussion with intimate friends of his own sex, 
he is most interested when he talks about phi- 
losophy and psychology, literature, socialism and 
social amelioration rather than the meaning 
of life. 

Variable 22. Loading, 43. He feels that our 
modern industrial and scientific developments 
are not signs of a greater degree of civilization 
and culture than those attained by any previous 
race, such as the Greeks. 

Variable 17. Loading, :37. He would prefer to 
hear a series of popular lectures on the con- 
temporary painter rather than the progress and 
needs of social-service work in the cities of his 
part of the country, 

Variable 7. 
the New York 
ested in the sei 
the real-estate 
stock market. 

Variable 39. Loading, .35. 
town and had more than e 
needs, he would prefer to 
church to which he belo: 


versity for the development of scientific research 
devote it to hospitals; rather than apply it pro. 
ductively to industrial development. 

Variable 26, Loading, .34, Taking the Bible as 
a whole, he would prefer to терага it from the 
point of view of its beautiful mythology and 
literary style rather than as а spiritual revela- 
tion. 

Variable 15. Loading, .32. If he had the оррог- 
tunity, and if nothing of the kind existed in the 
community or college where he lived, he would 
prefer to found a classical orchestra rather than 
a debating society. 


Variable 1. Loading, .g2. He believes that the 


Loading, .36. In a Paper such as 
Sunday Times, he is more inter- 
ction on picture galleries than in 
section and the account of the 


If he lived in a small 
nough income for his 


nged, give it to a uni- 
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main object of scientific research sicul е po 
discovery of pure truth rather than its pra 
lications. А А 

"Variable 44. Loading, .32. Assuming ee не 
had Ge necessary ability and that the E) 2 d as 
each of the following occupations was rr 
he would prefer to be a Хзненанбав, o o 
man, or politician; rather than a sales n lié 

Variable 16. Loading, .30. At an wore 
prefers to see scientific apparatus or С 
products rather than automobiles. 


Factor II appears to be a ipsi 
measuring aspects of aesthetic е a 
tion and a tendency, often apiha be 
artists, toward lack of conventiona 2 
havior or beliefs. Variables 1, 7) adi 
39, and 43, together possibly with ko 
ables 16 and 44, suggest that the b е 
conventionality tends to duum e 
negative reactions toward aspects © rie 
ness and industry. Although gome is reli- 
negative alternatives are social OT 
gious, none are political. КОРОР 7: 

It should be noted that a d 
reading of Arts and Decorations ( sind 
able 19), for collecting paintings “the 
sculpture (Variable 45), belief yt 
importance of ideals of pore m 42) 
able 54), liking for ballet (Variable are 
and liking for scenery (Variable ot 
not indicative of high scores on. су. 
II, although these must douHU irar 
Classified as indicating aesthetic inc also 
tions. Variables 4, 19, and 35 416 hese 
uncorrelated with Factor II. oneal Mos 
are the only items related to litera fac 
the aesthetic tendencies involved pt 
tor II appear possibly to be mm 
the fine arts. The loading of Viadi 
47 Suggests a desire on the part O pear 
viduals high on Factor П to api ар 
sophisticated or, at least, to ауО!© ping 
pearing naive, a tendency in a es 
with the general tenor of the var’ 
correlating with the factor. petwee? 

There appears no relation ? Jate^ 
Factor II and any of the factors M hip 
by Lurie, nor any consistent relatio 
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to any of the measures obtained by scor- 
ing the original test. 
. The distinction between "we" and 
they" groups often employed by soviolo- 
gists may be important in understanding 
the determiners of the individual dif- 
ferences measured by Factor II. Persons 
high on Factor П possibly think of 
themselves as apart from others express- 
ing conventional attitudes, and their be- 
liefs serve as a means of identification 
with their group. A large proportion of 
the responses of an individual high on 
Factor II might tend to "shock" a con- 
ventional person. 

Very possibly, the difference between 
Factors I and II centers in this aspect of 
Factor П. If, as was suggested in discuss- 
ing the relation between Factor I and 
Lurie's Factor П, persons high in socio- 
economic status have greater opportu- 
RS n develop aesthetic inclination, the 

phasis on the "we" and "they" 
mechanism would appear even more 
justifiable. An additional and more ap- 
parent difference is that Factor П is less 
general than Factor І and accounts for 
less variance. 

Factor II will tentatively be regarded 
as measuring “interest in the fine arts.” 


Factor III: Belief in “Culture” 


ee 21? Loading, -55- He feels that the 
bee the churches at the present time should 
Ойлы d spiritual worship and a sense of 
brin inion with the highest; rather than to 
pe g out charitable tendencies and to urge 
Ople to think more of the good of others. 
in 62 Loading, 51. He considers high 
traf s and reverence more desirable character 
ve than unselfishness and sympathy. 
it ee 58. Loading, 45. He would prefer, 
conta were to marry, a wife who could achieve 
othe prestige commanding admiration from 
her 18, one who is fundamentally spiritual in 
attitude toward life, or one who is gifted 
———— 


a Р 
h. Both statement and sign of factor loading 
ave been reversed. This reversal allows listing 


о ioe Ka 
Ë the loading in positive form. 


along artistic lines; rather than one who likes 
to stay at home and keep house. 

Variable 35. Loading, 44. If he could influence 
the educational policies of the public schools 
of some city, he would undertake to promote 
the study and the performance of the drama; 
rather than to develop cooperativeness and the 
spirit of service, to provide additional laboratory 
facilities, or to promote school savings banks for 
education in thrift. 

Variable 36. Loading, .37- If he could influence 
the educational policies of the public schools, he 
would undertake to promote the study and the 
performance of the drama, to provide additional 
laboratory facilities, to promote school savings 
banks for education in thrift; rather than de- 
velop cooperativeness and the spirit of service. 

Variable 4. Loading, .37- If he were a uni- 
versity professor and had the necessary ability, 
he would prefer to teach poetry rather than 
chemistry and physics. 

Variable 54- Loading, .35- He believes that 
one should guide one’s conduct according to, 
or develop one's chief loyalties toward, one's 
ideals of beauty; rather than one's religious faith, 
one's business organizations and associates, Or 


society as à whole. 
Variable го. Loading, -34- He would encourage 


his children to make several teams rather than 


to have vocational training. 
Variable 44. Loading, .32- Assuming that he 
d that the salary 


had the necessary ability an 
for each of the following occupations was the 


same, he would prefer to be a mathematician, 
clergyman, ог politician; rather than a sales 


manager. 


Factor III correlates positively with 
two religious and four aesthetic vari- 
ables, but does not generally follow the 
attern of any of the Allport-Vernon 


scoring keys. 
The common element here involved 
seems best described as a scale differenti- 
ating the person interested in the “higher 
things of life" from those concerned with 
a more rational or realistic viewpoint; 
and persons striving, possibly, for “cul- 
ture,” from those antagonistic toward 
or suspicious of the intangible nature of 


such evaluative tendencies. 


It should be noted that none of the items 
which tend to be selected by a person with a 
positive score on Factor III have obvious, prac- 
tical, or immediately observable value; none are 
related to apparent biological or social needs. 
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A person who stresses immediate, tangible bene- 
fits can see them resulting from “thinking more 
of the good of others,” “providing laboratories,” 
“promoting thrift or unselfishness,” “chemistry,” 
“staying home and keeping house," “vocational 
training,” or “being a sales manager”; but such 
things as “spiritual worship,” “drama,” “high 
ideals and reverence,” “poetry,” and “ideals of 
beauty” have value which is difficult to justify on 
obvious rational grounds. Possibly acceptance of 
the personal values evident in the variables listed 
under Factor ШІ depends upon intuitive or 
mystical processes. Emotional overtones sub- 
jectively important to the individual may play 
an important role. Attention is invited to the 
considerable proportion of items dealing with 


^ ethical problems. 


In all, the name “Belief in Culture" 
characterizes Factor III with reasonable 
adequacy. 


Factor IV: Antireligious Evaluative 
Tendency 


Variable 53. Loading, .78. He believes that 
one should guide one’s conduct according to, 
or develop one’s chief loyalties toward, one’s 
ideals of beauty, one’s business organizations 
and associates, society as a whole; rather than 
toward one's religious faith. 


Variable 40. Loading, .75. If he lived in a 
small town and had more than enough income 
for his needs, he would prefer to apply it pro- 
ductively to industrial development, give it to a 
university for the development of scientific re- 
search, or devote it to hospitals; rather than 
help to endow the church to which he belongs. 

Variable 24. Loading, .61. He feels that the 
world would not be a much better place if we 

took to heart the teaching, “Lay not up for 
yourselves treasures upon earth . . . but lay up 
for yourselves treasures in heaven, where neither 
moth nor rust doth corrupt, and where thieves 
do not break through nor steal.” 

Variable 96. Loading, 58. Taking the Bible 
as a whole he would prefer to regard it from 
the point of view of its beautiful m 
and literary style rather than as а 
revelation. 

Variable 11. Loading, .44. When he visits a 
cathedral, he is more impressed by the architec- 
tural features and stained glass than by a pervad- 
ing sense of reverence and worship. 

Variable 34^ Loading, .43. He believes that a 
man who works in business all week can best 
spend Sunday by trying to win at golf or racing; 
rather than in trying to educate himself by 
reading serious books, going to an orchestral 
concert, or hearing a really good sermon. 


ythology 
Spiritual 
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Variable 59. Loading, He would like E: 
think of Leonardo da Vin The Last SUPPE 
as one of the most priceless and итер ү 
pictures ever painted, in relation to es: 3 
versa¥ility and its place in history, or Sing 
masterpiece of design; rather than as e 
the highest spiritual tendencies and hip 
Variable 28. Loading, .42. If he were to oe ald 
a topic on which to write an essay, Де anal 
choose the defects of our present educa ing 
systems rather than the role of church-go 
in religion. Me » 
Variable 6. Loading, 40. He considers Unt 
fishness and sympathy more desirable ch 
traits than high ideals and reverence. | ЖО 
Variable 35. Loading, .38. If he could eer d 
the educational policies of the public SE die 
some city, he would undertake to pron rather 
study and the performance of өкү spirit 
than to develop cooperativenes and oratory 
of service, to provide additional 1а nks for 
facilities, or to promote school savings Ба 
education in thrift. : ves that the 
Variable 13. Loading, .38. He believes ulated 
evidence that has been impartially б ы 
goes to show that the universe has Ev chanistic 
its present state in accordance with mecha 
principles, so that there is no need t hind it- 
a first cause, cosmic purpose, or God behint, 


discovery of the steam engine with th "ES 
quent industrialization and economic ih y than 
American and European countries; p of the 
by the freeing of slaves with enhancemen 
value placed on individual life. that the 
Variable 21, Loading, .35. He feels ype 


x ld 
aim of the churches at the present time sho игр 
to bring out charitable tendencies, 22° 7 grs, 
people to think more of the good 0 and 2 
rather than to convey spiritual worship 
sense of communion with the highest. goes to 

Variable 42. Loading, .33. When he 1 


the theatre, he enjoys most, as a rule, ne an 
Similar imaginative performances; rat A lays 
plays that treat the lives of great We Jove, 
with a theme of human suffering cns som 
problem plays that argue consistently 

point of view. 


With the exception of Variables p 
18, 38, and 47, all of the religion 
ables have significant negative loa ur 
Factor IV, and of these five excep 
Variables g and 18 both have loa 


i TIA 
greater than „зо. While Variables 5 


r joadin€ 
“Both statement and sign of facto 
have been reversed, 


ee — т—— 
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and 47 are regarded as religious by the 
authors of the test, this interpretation ap- 
pears questionable. This difference in in- 
terpretation, which concerns à poscible 
distinction between particular religious 
organizations and general religious atti- 
tude, will be considered in later discus- 
sion of the meaning of this factor. 

As in the case of Factor I, the more 
general interpretation is quite clear. 
Factor IV is with little doubt antireli- 
81ous in nature. While its more specific 
Interpretation is not so clear, several 
Pa bilities will be discussed in the 
ollowing paragraphs. 

А It appears plausible that Factor IV is con- 
Е with the operation of the church as an 
EPUM that it concerns the creed and social 
ЗНОВ of the Christian church; and that it 
Sep not measure any fundamental evaluative 
ван common (о religious individuals of other 
ras the Christian creed. (It will be convenient 
lo speak of religious evaluation even though 
е w scores are indicative of high religious evalua- 
ee tendency.) In the absence of any direct indi- 
р ion to the contrary, “Christian” will refer to 
RN the Protestant and Catholic churches. Those 
А ems loaded to the extent of .45 Or greater most 
aly give the impression of measuring mere 
mr nona, indoctrination. In numerous in- 
ES the social forces which operate to ostra- 
Ps the doubter and disbeliever appear to be 
e ining the responses. The aforementioned 
wigniirant loadings of Variables 3, 38, and 47, 
ae were apparently included by the authors 
" the test in an attempt to broaden the measure 
ds religious evaluation beyond that of the con- 
ventional church member, are important to this 
Interpretation. 
je itin support of this theory is found in the 
589 of certain variables on the religious 
SOR appearing in Lurie's analysis, in that 
m bles with component items designed to 
easure a religious evaluative tendency more 
Exe than that involved in the Christian 
idigion did not have high loadings on his re- 
igious factor. It is possible that if these com- 
Ponent items measuring religious evaluative 
endency non-Christian in nature could have 
hoe separated from the remaining items, oF 
these, measuring Christian religious evaluation 
at such non-Christian items would have been 
d to correlate negatively with his religious 
AES Variable 22, wherein the items all concern 
5 Nventions of the Christian religion, is the only 
atiable in Lurie's analysis heavily involving 


his religious factor. 

Certain further elaborations upon the simple 
hypothesis of religious tendency are suggested. 
Since agreement with such phases as "the aim 
of the churches at the present time should be 
to bring out charitable tendencies, and to urge 
people to think more of the good of others" 
(Variable No. 21), schools should develop “co- 
operativeness and the spirit of service" (Vari- 
able No. 36), or “he considers unselfishness and 
sympathy more desirable character traits than 
high ideals and reverence” (Variable No. 6) is 
always indicative of nonreligious tendency inso- 
far as this may be determined by Factor IV, it 
is not unreasonable to conclude that religious 
tendency as defined by Factor IV is not primarily 
ethical in nature. ОЁ course, two of these above- 
listed statements, namely those from Variable 6 
and 21, involve a choice between ethical values 
which should be related to religious evaluative 
tendency. However, in the remaining instance, 
that from Variable 36, even though no choice 
was involved between ethical and other aspects 
of religious evaluation, the same negative cor- 
relation was observed. 

А consideration of Variables 6, 11, 21, 26, and 
59 leads to the conclusion that reverence is an 
important aspect of religious evaluation as de- 
fined by Factor Iv. This is in agreement with 
the previously suggested interpretation of Factor 
IV as a measure of the tendency to accept the 
teachings of the church without question. 


In summary, then, Factor IV is un- 
doubtedly antireligious in nature and 
is probably concerned largely with evalu- 
ation of the church as an institution. 
Factor IV will be referred to as "Anti- 
religious Evaluative Tendency." 


Factor V: A ntiaggression 


Variable 56. Loading, .71. Florence Nightingale, 
Henry Ford, or Charles Darwin interests and 
attracts him more than Napoleon. ў 

Variable 25. Loading, .51- He is more inter- 
ested in reading accounts of the lives and works 
of such men as ‘Aristotle, Plato, and Socrates than 
of Alexander, Julius Caesar, and Charlemagne. 

Variable 55- Loading, .49- Florence Nightin- 
gale interests and attracts him more than Na- 

oleon, Henry Ford, or Charles Darwin. 

Variable 3- Loading, .46. He does not believe 
that because of the aggressive and self-assertive 
nature of man the abolition of war is an illusory 
ideal. ‘ 

Variable 36° Loading, 45. If he could influ- 
Le 


з Both statement and sign of factor loading 
have been reversed. 
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ence the educational policies of the public 
schools, he would undertake to develop coopera- 
tiveness and the spirit of service; rather than 
to promote the study and the performance of 
the drama, to provide additional laboratory 
facilities, or to promote school savings banks 
for education in thrift. 


Variable 46. Loading, .37. If he had unlimited 
leisure and money, he would prefer to establish a 
mental hygiene clinic for taking care of the 
maladjusted and mentally deficient; rather than 
make a collection of fine sculptures or paintings, 
aim at a senatorship or a seat in the Cabinet, 
or enter into banking and high finance, 


Variable 51. Loading, .35. Great exploits and 
adventures of discovery such as Lindbergh's and 
cByrd's seem significant because they add to our 
knowledge of mechanics, geography, meteor- 
ology, etc, weld human interests and interna- 
tional feelings throughout the world, or con- 
tribute to the ultimate revelation of the mcan- 
ing of the universe; rather than because they 


Tepresent conquests by man over the difficult 
forces of nature, 


Variable 43. Loading, .29. Assuming that he 
had the necessary ability and that the salary 
for each of the following occupations was the 


same, he would prefer to be a mathematician; 
rather than a sales manager, clergyman, or 
politician, е 

While the relation of the Allport- 
Vernon theoretic score to Factor V is 
not so clearly evident as in the case of 
Factors I and IV, 


there are certain re- 
semblances w 


hich will bear comment. Of 
the 8 variables with significant loading 
on Factor V, 4 were political, and of the 
remaining 8, 2 involved political evalu- 
ations as alternate choices. АП of 
such political evaluations correlated 
negatively with Factor У. On the positive 
pole, 3 of these above-listed variables 
were social and 2 alternative choices 
were social. One of the variables is 
theoretical and 4 additional variables 
involved alternative choices similarly 
designated. It appears that Factor V ma 
be best described in terms of the evalua- 
tive scores as social, and possibly theo- 
retic on the positive pole and as political 
on the negative pole. 

Examination of the listing of vari. 
ables with high loading on Factor V 


suggests that, on the negative pole, the 
interests and evaluations expressed seem 
related to conflict, possibly even more to 
armed conflict, while on the pu 
side, the intellectual interests and socia 
sympathies which seem to be expressed 
are somewhat withdrawing in nature. It 
should be noted that none of the theo- 
retic items involved in Factor V are 
measures of interest in the natural sci- 
ences. None of the items high on Factor 
V scored as social appear to concern 
social issues which are in active dispute 
at the present time. р 

The term “Antiaggression” will serve 
to identify Factor V. 


— y 
Factor VI: Humanitarian Tendency 


Я jn a 
Variable 39. Loading, .54. If he lived oes 
small town and had more than cnough dow 
for his needs, he would prefer to use it to a to a 
the church to which he belonged, give ‘a те- 
university for the development of scient! ы ply 
search, devote it to hospitals; rather than ар 
it productively to industrial development. refer 
Variable 9. Loading, .5о. He should р K 
to read the headlines “Protestant Leader ant 
Consult On Reconciliation” rather than 
Improvements In Market Conditions.’ 
Variable 55. Loading, .48. Florence 
gale interests and attracts him more than 
poleon, Henry Ford, or Charles Darwin sieve 
Variable 12. Loading, .47. He docs not oid be 
that contemporary charitable policies б indi- 
curtailed because they tend to undermin 
vidual initiative, ; that 
Variable 32. Loading, 45. He Bio ibis 
good government should aim at more a more 
poor, sick, and old, the introduction © macy: 
ethical principles into its policies and Oe a 
the establishment of a position of page de- 
Tespect among nations; rather than t 
velopment of manufacturing and trade. - 
Variable g1. Loading, .g4. Не belie 
Bood government should aim at more jeveloP* 
the poor, sick and old; rather than the c juctio? 
ment of manufacturing and trade, MIRO d and 
of more ethical principles into its pae atl 
diplomacy, or the establishing of а l 
of prestige and respect among лавова. refer 
Variable 175 Loading, .32. He vorig pros” 
to hear a series of popular lectures on t 
35 Joadins 
^Both statement and sign of factor 
have been reversed, 


sohtin- 
Night? 


а- 
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ress and needs of social-service work in the cities 
of his part of the country rather than on the 
contemporary painter, 

Variable 46. Loading, .32. If he had unlimited 
leisure and money, he would prefer to ¢ ablish 
a mental hygience clinic for taking care of the 
maladjusted and mentally deficient; rather than 
make a collection of fine sculptures or paintings, 
aim at a senatorship or a seat in the Cabinet, or 
enter into banking and high finance. 


On the positive pole, Factor VI 
heavily involves social variables and 
correlates negatively with a number of 
items measuring economic evaluative 
tendency. An appreciable number of 
items measuring theoretic evaluative 
tendency correlate with Factor VI. While 
there might seem to be some resemblance 
to Factor V because of the large number 
of social items involved in each instance, 
they differ from each other in that social 
items of Factor V are largely concerned 
With evaluations of persons or of charac- 
— of persons while those high on 

actor VI tend more to be concerned 
ни social issues. Possibly Factor VI сап 
dest be described as concerned with in- 
terest in social reform that will aid in 
improving the welfare of the under- 
privileged. The term Humanitarian 
Tendency appears most appropriate of 
those occurring to the author. 

Р In the above listing only Variable 9 appears 
t all inconsistent with this statement as to the 
Nature of Factor VI. Even here the inconsistency 
1s not so much in its loading on Factor VI but 
P the size of the loading. With the possible 
exception of Variables 6 and 21, none of the 
Variables having near zero loading on Factor VI 
appear to measure the primary trait described 
in the above hypothesis. The abstract statement 
of Variables б and 21 and the fact that both 
Involve a religious evaluation as an alternative 
to an apparent measure of а humanitarian 
ilen, may help to explain their lack of 
oading on Factor VI. 

Factor VI might be regarded, on the surface, 
as resembling Lurie's Factor I, which he inter- 
Preted as being social in nature. However, in 
spite of the many items high on Factor VI which 
Were intended as a measure of the “social man," 
à dose comparison of the individual items of 


Factor VI reveals little definite resemblance. 

Variables 14 and 27 are the only apparent 
measures of humanitarianism not "loaded on 
Factor VI. Of these two, Variable 27 has a 
loading of .237. 


The term "Humanitarian Tendency” 
will be used to indentify Factor VI. 


Factor VII: Interest in Science 


Variable 19.7 Loading, .56. If he had some time 
to spend in a waiting room and there were only 
two magazines to choose from, he would read 
The Scientific American rather than Arts and 
Decorations. 

Variable 10. Loading, .55. He would prefer too 
read the story “Physicists Make Important Dis- 
coveries Concerning The Structure Of Atoms” 
rather than “Threat To Constitutional Govern- 
ment In Germany By A Dictator.” 

Variable 4.7 Loading, .52. If he were a uni- 
versity professor and had the necessary ability, 
he would prefer to teach chemistry and physics 
rather than poetry. 

Variable 16. Loading, 40. At an exposition he 
prefers to sce scientific apparatus or chemical 
products rather than automobiles. 

Variable 35^ Loading, .36. If he could influ- 
ence thé educational policies of the public 
schools of some city, he would undertake to 
develop cooperativeness and the spirit of service, 
to provide additional laboratory facilities, or to 
promote school savings banks for education in 
thrift; rather than undertake to promote the 
study and performance of drama. 

Variable 34. Loading, .34. He believes that 
a man who works in business all week can best 
spend Sunday in trying to educate himself by 
reading serious books, going to an orchestral con- 
cert, or hearing a really good sermon; rather 
than by trying to win at golf or racing. 

Variable 46. Loading, .31- If he had unlimited 
leisure and money, he would prefer to establish 
a mental hygiene clinic for taking care of the 
maladjusted and mentally deficient; rather than 
make a collection of fine sculptures or paintings, 
aim at a senatorship ог а seat in the Cabinet, 
or enter into banking and high finance. 


АП except three of the variables sig- 
nificantly loaded on Factor VII clearly 
imply an interest in the sciences. Fur- 
thermore, with the possible exception of 
Variable 49, which has a loading of .231, 
there are no additional items in the 


— — 


Both statement and sign of factor loading 
have been reversed. 
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present analysis not loaded on Factor 
УП which can readily be interpreted as 
measuring such interest. Hence, there 
appears little doubt that Factor VII is a 


primary trait measuring interest in 
science. 


The loadings of the three items not obviously 
concerned with interest in science, namely, num- 
bers 34, 35, and 46, are not necessarily inconsistent 
with this hypothesis as to the nature of Factor 
VII. It should be noted that one of the alter- 
natives of Variable 35 is concerned with the 
promotion of laboratory work in the schools. 
This may partly explain its loading on Factor 
"ur Possibly, with reference to Variable 34, it 
is characteristic of scientists that they dislike 
the idea of promoting the study of drama in the 


public schools, 

The isolation of Factor VII, which 
involves only a few of the theoretical 
items of the present analysis, clearly indi. 
cates the existence of several rather than 
a single primary trait of theoretical 
evaluative tendencies, Lurie’s findings of 
a single primary trait of theoretical in- 
terest is probably due to the complexity 
of the variables in his analysis. (It will 
be remembered that each of his yari- 
ables was the sum of Several items.) It is 
interesting in this connection that a 
minus rotation, in Lurie's analysis, of 
Factor V on Factor 1 would leave only 
Variables 1 and 3 of his analysis high on 
Factor V. His Factor V would, then, bear 


Some resemblance to Factor VII of the 
present analysis, 


Factor VII will be i 


dentified by the 
term, “Interest in Scien: 


(ae 


Factor VIII: Tendency 
toward Liberalism 


a whole; rather than one 
trious, and of a practical 
possesses qualities of leadershi 
ability, or one who shoy 
tional sensitivity, 


Variable 34. Loading, 52. He believes that a 


man who works in business all week can he 
spend Sunday in trying to educate ga 
reading serious books, going to an ise mike 
concert, or hearing a really good sermon; га 

than trying to win at golf or racing. чер 

Variable 37. Loading, .45. He would pr ted 
friend 02 his own sex who is seriously Bie ud р 
in thinking out his attitude toward li feat 
whole, one who possesses qualities of 1680 refine- 
and organizing ability, one who shows T бен 
ment and emotional sensitivity; rather Шар el 
who is efficient, industrious, and of a prac 
turn of mind. а is next 

Variable 40. Loading, .43. During A PY 
summer vacation he would prefer to ipeum 
publish an original biological essay or Е f the 
rather than stay in some secluded part ше 
country where he could appreciate fine pape 
80 in for a local tennis or other athletic pes о 
ment, or get experience in some пем 
business. ы inion 

Variable 14. Loading, .41. In his aaa the 
eral progress has been advanced us Y alue 
freeing of slaves with enhancement of aa the 
placed on individual life rather than sequent 
discovery of the steam engine with con Ameri- 
industrialization and economic rivalry in 
can and European countries. 

Variable 12. Loading, 39. He docs nee uld 
that contemporary charitable policies шо indi- 
curtailed because they tend to undermin 
vidual initiative, saves that à 

Variable 33. Loading, .38. He believes ne 
man who works in business for his living à edu- 
week can best spend Sunday in trying to Г 
cate himself by reading serious books; i 
than by trying to win at golf or тарава а 
to an orchestral concert, or by hearing @ 
good sermon, believe 

Variable 27. Loading, .37. He docs not hich а 
that since the class or social status Ka bes a 
man belongs depends mainly upon his pu A 
ability, it is just that a small proportion 
Population should be very rich. saves Ш 

Variable 31. Loading, .35. He bclicv i 
8001 government should aim at more елор" 
the poor, sick, and old; rather than the dictio 
ment of manufacturing and trade, M er an 
ОЁ more ethical principles into its po 
diplomacy, or the establishing of a pos! 
prestige and respect among nations. 

Variable 54. Loading, .34. He believe to, 
should guide one's conduct according | ideals 
develop one's chief loyalties towards, anh опе” 
of beauty; rather than one's religious fait "socie y 
business Organizations and associates, OT 
as a whole. 1 

Variable бо, Loading, .34. Не would he 
think of Leonardo da Vinci's picture T jritual 
Supper" a; expressing the highest SP Leo- 
tendencies anq emotions, in relation (0 


gen- 


believe 
1 be 


n 
he 


s that one 


ike 10 
Last 


Sr. 
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nardo's versatility and its place in history, as a 
masterpiece of design; rather than as one of the 
most priceless and irreplaceable pictures ever 
painted, 

Variable g2. Loading, .33. He believ& that 
good government should aim at more ,aid for 
the poor, sick, and old, the introduction of more 
ethical principles into its policies and diplomacy, 
the establishment of a position of prestige and 
respect among nations; rather than the develop- 
ment of manufacturing and trade. 

Variable 58. Loading, .30. He would prefer, if 
he were to marry, a wife who could achieve 
social prestige, commanding admiration from 
Others, one who is fundamentally spiritual in 
her attitude toward life, one who is gifted along 
artistic lines; rather than one who likes to stay 
at home and keep house. 

Factor VIII heavily involves items 
intended as measures of the economic 
man on its negative pole and correlates 
positively with items intended as meas- 
ures of the social and of the theoretic 
man, Thus, there are 7 economic vari- 
ables high on Factor VIII and 4 with 
€conomic alternatives. On the other 
hand, the principal items in 4 of the 
above-listed variables and alternatives 
їп 2 additional variables are social meas- 
ures. Two variables and alternatives of 
8 additional variables loaded upon Fac- 
tor VIII are theoretic measures. Vari- 
ables 5, 7, 9, 20, 22, 24, 29, 39, and 44 
Comprise a listing of those economic vari- 
ables not significantly loaded on Factor 
VII. If we neglect Variables 5 and 20 on 
the ground that they are not loaded sig- 
nificantly on any of the primary traits of 
the present analysis, and Variables 22 and 
24 on the ground that their loadings ap- 
Proach significance, and compare the 
remaining above-listed variables, namely, 
Numbers 7, 9, 29, and 39 with numbers 
12, 14, 87, 82, 88, 27, and 28 of the list 
9f variables high on Factor VIII, it 
oe apparent that the economic items 
fed on Factor УШ may be dif- 
*rentiated from those not so loaded in 
t Р B ir- 
SS they either state or imply the desir 

ility or undesirability of characteristics 


of our economic system. Further evidence 
of a similar nature is found in examining 
the afore-mentioned social and economic 
variables significantly loaded on Factor 
VII. These may likewise be differentiated 
from social and theoretic variables not 
loaded on Factor VIII in that the former 
are concerned with social issues whereas 
the latter are'not. By and large these 
social and theoretic items might be de- 
scribed as expressing beliefs favoring 
the underprivileged groups or possibly, 
as being "liberal" or "New Dealish.” 
This may not be so apparent in the 
case of Variables 34, 37, 38, and 4g. 
However, these can be explained by the 
plausible assumption that beliefs con- 
cerning economic systems are in part, 
at least, a function of social groupings 
and the ways of life of these social 
groups. 

If weeassume similar tendencies on the 
part of the "liberals" at the opposite 
pole, we may readily understand the 
loadings of Variables 38 and 49. Since 
Variables 34, 37, 38, and 49 all have 
higher-than-average loadings, it would 
seem that such preferences are them- 
selves better-than-average measures of 
liberal tendencies and are more funda- 
mental variables in the cluster of traits 
defined by this factor. 

The term “Tendency toward Liberal- 
ism" will be employed to designate 
Factor VIII. It is suggested that the 
factor measures differences between 
social groups such as business men on the 
one hand and “liberals” or “New Deal- 
ers” on the other. 


While Lurie's Factor II (which he labeled 
a measure of philistine tendencies) bears rather 
general resemblance to Factor VIIT, more specific 
examination of the variables defining the two 
factors suggests that the resemblance is super- 
ficial. Thus, Lurie's Factor II is correlated with 
variables measuring interest in politics and with 
others that he had regarded as aesthetic. These 
latter are similar to those highly loaded on 
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Factor П of the present analysis. А further 
difference is found in the lack of social or 
theoretic variables in Lurie's Factor II, although 
the resemblance of Lurie's "social" and "theo- 
retic" variables to those of the present analysis 
is so uncertain as to make comment on this 
discrepancy rather difficult, 


Since Factor VI appeared also to in- 
volve a liberal or progressive point of 
view, certain differences between these 
factors will be indicated. The high load- 
ing of Variables 17, 46, an 55 on Factor 
VI and their near zero loadings on Fac- 

"tor VIII suggest that the personal and 
emotional component of Factor VI is 
absent in Factor VIII. By contrast, Fac- 
tor VIII is impersonal and intellectual. 
Similarly, the loadings of Variables 9, 
39, and possibly 7 suggest that the person 
high on Factor VI is likely to show no 
interest in business or industry while the 
individual high on Factor VIII is ap- 
parently as likely as the persons low on 
Factor VIII to show interest in business 
trends. The distinguishing characteris- 
tic of the person high on Factor VIII is 
his disagreement with the evaluations of 
business men, but not in his lack of in- 
terest in economic problems. 


Factor IX: Theoretic Interest 


Variable 48. Loading, 64. At an evening dis- 
cussion with intimate friends of his Own sex, 
he is Most interested when they talk about 
philosophy and psychology; rather than the 
meaning of life, literature, Or socialism and 
social amelioration, 

Variable 47. Loading, .56. At an evening dis. 
cussion with intimate friends of his ow 
he is most interested whe 
ophy and psychology, 
social amelioration; 
of life. 

Variable 49. Loading, 42. 
summer vacation, he would pr 
publish an original biological essay Or article; 
rather than stay in some secluded part of the 
country where he could appreciate fine scenery, 
go in for a local tennis or other athletic tourna- 
ment, or get experience in some new line of 
business, 

Variable 21. Loading, 


During his next 
efer to write and 


40. He feels that the 


aim of the churches at the present time sah 
bring out charitable tendencies, and urge ре ет 
to think more of the good of others; ra id 
than to convey spiritual worship and a SC 
of cofimunion with the highest. — 
Variable 16. Loading, .37. At an espe ical 
he prefers to sce scientific apparatus or cher 
products rather than automobiles. dits a 
Variable 11. Loading, .36. When he P Lists 
cathedral, he is more impressed by the arc ihe 
tural features and stained glass than by 
pervading sense of reverence and poo ыы 
Variable 23. Loading, .33. If he were Mis apt 
in a strange living room, he would be ЕТ 
to judge the owner's knowledge EM cokcases 
tuality as shown by the books in his bo shown 
than his friendliness and hospitality prr 
by the photographs on the walls and the 8 
comforts of the room. t think 
Variable 8. Loading, .33. He does дез Жын is 
that а person who analyzes his. E an ont 
apt to be less sincere in his feeling th 
who is not so reflective. 


Of the above listing, Variables 48, “ш 
16, 28, and 8 are all scored as Oe fis 
If we exclude from consideration ; 
several items involved in Factor Vari- 
the interest in science factor: vide that 
ables 15, 52, and possibly 25, ү ctor 
these have marginal loadings on Fa ah) 
IX; and Variables 15, 52, and possibly = 
in that they have marginal ^ si 
Factor IX, then Variables 1, 38, ап heo- 
are the only remaining measures of F on 
retic evaluative tendency not ipei 21, 
Factor IX. Although Variables 11 om" on 
both of which are significantly -— as 
Factor IX, contain no items intende, 
measures of theoretic tendericy, E are 
author’s Opinion that these variables tet 
nonetheless indicative of theoretic "able 
ests. The alternative items in Var pal 
47 undoubtedly explain the findings rent 
this variable correlates with an app? nse 
measure of theoretic tendency- ca as 
quently, Factor IX will be regarde ne 
a measure of theoretic interests- ari- 
theoretic element common to the X 
ables having high loadings on en * 
is identified with somewhat more © о 
dence than in the case of a потег 


ч. 
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the remaining factors, since the variables 
concern a considerable variety of activi- 
ues and beliefs. 
о 
^ eu dr been mentioned that Lurie 
eide ae theoretic primary evaluative 
УП De The relation of this trait to Factors 
Piobelily x of the present analysis is not clear. 
MEETS y the present analysis, with less complex 
ful es has succeeded in breaking Lurie's 
hon primär trait into two separate factors. 
seni of these two factors bears striking re- 
this dee to Lurie's theoretical factor. In part, 
fact t — duc to the earlier mentioned 
see aime EM theoretic (and social) variables 
ке jonit to relate to those of the Allport- 
on test, 


Factor X: “Rugged Individualism” 


ae 33. Loading, 53. He believes that a 
ire ae "d works in business for his living all 
ке e best spend Sunday in trying to 
than 5 илге by reading scrious books; rather 
‘8 an y trying to win at golf, or racing, going 
an orchestral concert, or hearing a really 
good sermon. 3 
кош. 35 Loading, 47. He believes that 
of ma e a the aggressive and self-assertive nature 
hate! abolition of war is an illusory ideal. 
he: ўў able 57. Loading, 46. Не would prefer, if 
* меге to marry, a wife who would like to 
ты Done and keep house, one who is funda- 
опе Ё: у spiritual in her attitude toward life, 
than who is gifted along artistic lines; rather 
andes who can achieve social prestige com- 
Va IDE admiration from others. . 
TM 4 ende 36. Loading, -43- ТЕ he could influence 
he ie ucational policies of the public schools, 
the Onta undertake to promote the study and 
E RA. of the drama, to provide ad- 
saith al laboratory facilities, to promote school 
hans banks for education in thrift; rather 
àn to develop cooperativeness and the spirit 
of service, 
Variable 145 Loading, 4!- In his opinion, 
ше progress has been advanced more by the 
Scovery of the steam engine with the conse- 
guene industrialization and economic rivalry in 
doc cun and European countries, than by the 
1 ing of slaves with enhancement of the value 
р VE on individual life. | 
"m ariable бо. Loading, .39. He would like to 
hink of Leonardo da Vinci's picture “The Last 
Supper” as expressing the highest spiritual 
x hdencies and emotions, in relation to Leo- 
ardo’s versatility and its place in history, as à 
Masterpiece of design; rather than as one of the 
Most priceless and irreplaceable pictures ever 
Painted. 


Variable 75 Loading, .37. In a paper such as 
the New York Sunday Times, he is more inter- 
ested in the real-estate section and the account 
of the stock market than in the section on 
picture galleries. 

Variable 125 Loading, .30. He believes that 
contemporary charitable policies should be cur- 
tailed because they tend to undermine individual 


initiative. 

When the rotations from the centroid 
to the primary-trait loadings were first 
thought to be complete, Factor X ap- 
peared of doubtful significance. Apart 
from the afore-mentioned difficulties in, 
the rotation of Factor X, its high satura- 
tion with the later centroid factors 
should suggest that its significance as a 
primary trait be accepted rather tenta- 
tively. Consequently, further rotations 
were made in an attempt to produce a 
more meaningful configuration. Al- 
though those items with loadings of 
borderline significance could be altered, 
those With loading above .4 maintained 
their identity throughout these addi- 
tional rotations. More careful examina- 
tion suggested that the common ele- 
ments to the variables of the above list- 
ing could be meaningfully interpreted. 

Factor X appears to be unrelated to 
any of the six original scores of the test 
or to any of the factors isolated by Lurie. 

Tentatively, it is suggested that Fac- 
tor X is related to the American tradi- 
tion of rugged individualism; to the 
belief that people get ahead through 
hard work and are motivated by compe- 


tition and desire for economic advance- 


ment. It is emphasized that this tradition 
as here interpreted has been closely asso- 
ciated with and advocated by business 
and industry. This hypothesis directly 
explains the loadings of Variables 33, 
9. 18. and 14. The belief in the inevita- 
bility of war expressed in Variable 3 is 


es 
8 Both statement ап 


have been reversed. 


d sign of factor loading 


22 HUBERT E. BROGDEN 


probably a generalization of the idea 
that man is competitive by nature. Vari- 
ables 5 and 7 may reflect the traditional 
middle-class male dislike of society, a 
dislike which would seem related to 
rugged individualism, while the loading 
of Variable 60 may express a revolt of 
such an individual against what he con- 
siders an “over-evaluation” of da Vinci's 
painting. It should be noted that the 
three alternative choices of Variable бо 
Suggest somewhat less enthusiastic evalu- 
ation. 
Factor X will be considered a measure 
of adherence to the evaluative standards 


associated with the term "Rugged Indi- 
vidualism." 


Factor XI: Residual in Nature 


Variable 52. Loading, .50. Great exploits and 
adventures of discovery such as Lindbergh's and 
Byrd’s seem Significant to him because they add 


е they rep- 
ficult forces 
nterests and 


resent conquests by man over the di 
9f nature, because they weld human j 
international feeling: 


Loading, 41. 
discovery such 


: hey add 

ge of mechanics, cography 
meterology, etc., because they weld human inter. 
ests and international feelin: 


good government should 
the poor, sick, and old, the i 
ethical principles into its Policies 
the ‘establishment of a Position 


° Both statement and sign of factor loading 
have been reversed. 


and respect among nations; rather Ba ше 
development of manufacturing and tra 5 E. 
Variable 36. Loading, .32. If he cou eic 
fluence the educational policies of the pu ШЕ 
schoo, he would undertake to promote D 
study and the performance of пе а 
provide additional laboratory facilities, M 
mote school savings banks for educ de 
thrift; rather than to develop cooperative 
and the spirit of service. e 
Variable 21. Loading, .3». He fecls rd 
aim of the churches at the present Hm hes {б 
be to bring out charitable tendency nets 
urge people to think more of the good o aad a 
rather than to convey spiritual worship а 
sense of communion with the highest. to the 
Variable 42. Loading, .3о. When he БО let or 
theater, he enjoys most, as a rule, ba than 
similar imaginative performances; rather lays 
plays that treat the lives of great men, у 
with a theme of human suffering and ard 
problem plays that argue consistently for 
point of view, be- 
Variable 27. Loading, .30. He does eo {б 
lieve that since the class ог social [our his 
Which a man belongs depends mainly T pro- 
push and ability, it is just that a sma rich. 
portion of the population should be very 


or 


No very consistent tendency is ару 
ent in the meaning of variables Wis 
high loading on Factor XI. Since, in E ; 
dition, few items have significant d 
ings, and the total variance accor ам 
for is small, and the projections = 1 
factor are heaviest on the later dh 
factors (which are heavily saturated W to 
Sampling error) it seems reasonable in 
conclude that this factor is residua d- 
nature. While it is often considered dé 
visable to rotate the reference axis of | t 
residual factor so that it is orthogona vi- 
the remaining reference axes, it is E. 
dent from Table 4 that a minus pee 
on Factor I, which will for peer a 
Purposes achieve orthogonality еи гу 
Factor XI and the remaining puru 
traits, will produce no substan tor 
changes in the variables high on ^ 


C. THE SECOND-ORDER FACTOR ; 
т š jon 
It will be recalled from discuss! 
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under “Procedure” that three second- 
order factors were extracted from the 
intercorrelations of the primary traits 
and that the loadings of the test ótems 
on these second-order factors were then 
computed. The interpretation of these 
second-order factors will now be con- 
sidered. In Table 6 these factors were 
labeled А, B, and C to distinguish them 
from the eleven first-order factors. 


Second-Order Factor A: Not Identified 


Variable 10, Loading, .51. He would prefer 
to read the story “Physicists Make Important 
Discoveries Concerning The Structure of Atoms” 
rather than “Threat To Constitutional Govern- 
ment In Germany By A Dictator.” 

_ Variable 132° Loading, 45. He docs not be- 
lieve that the evidence that has been impartially 
accumulated goes to show that the universe has 
evolved to its present state in accordance with 
mechanistic principles, so that there is no need 
to assume a first cause, cosmic purpose, ог God 
behind it. j 
Variable 18. Loading, .43- He would prefer 
to hear a series of lectures on the comparative 
development of the great religious faiths rather 
than the comparative merits of the forms of 
government in Britain and in the United States. 
Variable 42° Loading, 40. If he were a uni- 
versity professor and had the necessary ability, 
€ would prefer to teach chemistry and physics 
Tather than poetry. 
Variable 46. Loading, .39. If he had unlimited 
leisure and money, he would prefer to establish 
à mental hygiene clinic for taking care of the 
maladjusted and mentally deficient; rather than 
make a collection of fine sculptures or paintings, 
aim at a senatorship or a seat in the Cabinet, 
Or enter into banking and high finance. 
Variable 472° Loading, .37. At an evening dis- 
cussion with intimate friends of his own sex, 
he is more interested when he talks about the 
Meaning of life; than when he talks about 
philosophy and psychology, literature, or social- 
ism and social amelioration. 


Factor 4 is difficult to interpret. Since 
many of the first-order primary traits 
Were not as clearly defined as might be 
desired, the intercorrelations of these 
traits are probably more unstable than 
~ 


Both statement and sign of factor loading 


have been reversed. 


would be expected from sampling error 
alone. For this reason it would seem 
inadvisable to concern ourselves very 
greatly with the meaning of factors such 
as A which do not, in any case, account 
for a large proportion of the variance. 


Second-Order Factor B: Idealism vs. 
Practicality 


Variable 25. Loading, .67. He is more inter- 
ested in reading accounts of the lives and works 
of such men as Aristotle, Plato, and Socrates; 
than of such men as Alexander, Julius Caesar, 
and Charlemagne. ә 

Variable 45. Loading, .64. If he had un- 
limited leisure and money, he would prefer to 
make a collection of fine sculptures or paintings; 
rather than establish a mental hygiene clinic 
for taking care of the maladjusted and mentally - 
deficient, aim at a senatorship or a seat in the 
Cabinet, or enter into banking and high finance. 

Variable 44. Loading, .61. Assuming that he 
had the necessary ability and that the salary for 
each of the following occupations was the 
same, he would prefer to be a mathematician, 
clergyman or politician; rather than a sales 
manager) 

Variable 38. Loading, .61. He would prefer a 
friend of his own sex who is seriously interested 
in thinking out his attitude toward life as a 
whole; rather than one who is efficient, industri- 
ous, and of a practical turn of mind, one who 
possesses qualities of leadership and organizing 
ability, or one who shows refinement and emo- 
tional sensitivity. 

Variable 54. Loading, .бо. He believes that 
one should guide one’s conduct according to, 
or develop one’s chief loyalties toward, one's 
ideals of beauty; rather than one's religious faith, 
one's business organizations and associates, or 
society as a whole. 

Variable 37. Loading, 58. He would prefer 
a friend of his own sex who is seriously interested 
in thinking out his attitude toward life as a 
whole, one who possesses qualities of leadership 
and organizing ability, one who shows refine- 
ment and emotional sensitivity; rather than one 
who is efficient, industrious, and ofa practical 
turn of mind. 

Variable 34. Loading, .53. He believes that a 
man who works in business all week can best 
spend Sunday in trying to educate himself by 
reading serious books, going to an orchestral 
concert, or hearing а really good sermon; 
rather than by trying to win at golf or racing. 

Variable 49. Loading, .53. During his next 
summer vacation he would prefer to write and 
publish an original biological essay or article; 
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rather than stay in some secluded part of the 
country where he could appreciate fine scenery, 
compete in a local tennis or other athletic 
tournament, or get experience in some new line 
of business. 

Variable 31. Loading, 51. He believes that 
good government should aim at more aid for 
the poor, sick, and old; rather than the develop- 
ment of manufacturing and trade, introduction 
of more ethical principles into its policies and 
diplomacy, or the establishing of à position of 
prestige and respect among nations. 

Variable 55. Loading, .50. Florence Nightin- 
gale interests and attracts him more than Na- 
poleon, Henry Ford, or Charles Darwin. 

Variable 18, Loading, .50. He would prefer to 
fear a series of lectures on the comparative de- 
velopment of the great religious faiths rather 
than the comparative merits of the forms of 
government in Britain and the United States. 

Variable 56. Loading, .50. Florence Nightin- 
gale, Henry Ford, or Charles Darwin interests 
and attracts him more than Napoleon. 

Variable 41, Loading, .49. When he goes to 
the theatre he enjoys most, as a rule, the ballet 
or similar imaginative performances, plays with 
a theme of human suffering and love, problem 
plays that argue consistently for some point of 


View; rather than plays that treat the lives of 
great men. м 


Variable 29. Loading, .48. If he were to choose 
a topic on which to write an essay, he would 
prefer the Personality of some close friend of 
his rather than the necessities of life, luxuries, 
and savings, 

Variable 46, Loading, 48, If he had unlimited 
leisure and money, he would Prefer to establish 
a mental hygiene clinic for taking care of the 
maladjusted and mentally deficient; rather than 


tures or paintings, 
at in the Cabinet, 
and high finance, 


Variable 27. Loading, 47. He does not believe 


Variable 5, Loading, 46. He does not believe 
that because of the ageressive and self-assertive 
nature of man the abolition of war is an illusory 
ideal. 

Variable 57. Loading, 44. 
if he were to татту, a wife 
at home and keep house, o 
mentally spiritual in her atti 
one who is gifted along a 
than one who can achieve 
manding admiration from 

Variable In his opinion, 
ced more by the 
ent of the value 
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placed on individual life rather than by e 
discovery of the stcam engine with the con T 
quent industrialization and economic rivalry 
American and European countries. —— small 

Varigble 39. Loading, 38. If he lived ina en 
town and had more than enough income Mud 
his пеейѕ, he would prefer to help. to ene ч 
the church to which he belonged, give T e 
university for the development of scientific iy 
search, devote it to hospitals; rather than арр 
it productively to industrial pe р А ИЕ 

Variable 43. Loading, .35. Assuming act 
had the necessary ability and that the sa Me 
for each of the following occupations a кы 
same, he would prefer to be a mathemati аз, 
rather than а sales manager, clergyman, 
politician. 

Variable 17, Loading, .35 


5. He would pem 
to hear a series of popular lectures on oes 
temporary painter rather than on the рі о 
and needs of social service work in the citi 
his part of the country, 0 hat 
Variable g2, Loading, .33. He Believes АР 
good government should aim at more sf more 
the poor, sick, and old, the introduction | macy; 
ethical principles into its policies and ap and 
the establishment of a position of pese op. 
respect among nations; rather than the de 
ment of manufacturing and trade. time 
Variable 19. Loading, „зэ. If he had some were 
to spend in a Waiting room and there оц 
only two magazines to choose from, he этле 
read Arts and Decorations rather than 
Scientific American, 
Variable 


refer» 
He would pref 
if he were 


58. Loading, EID chieve 


to marry, a wife who could a from 
social prestige commanding admiration al in 
others, one who is fundamentally Spur pne 
her attitude toward life, one who is gifted 2 stay 
artistic lines; rather than one who likes to 
home and keep house, " tha 
Variable з. Loading, .31. He believes. ga 
man who works in business for his E u- 
Week can best s 
cate himself py reading serious books; 
than by trying to win at golf or racing, 
to an orchestra] concert, or hearing a really 8' 
sermon, li 
Variable 12, Loading, .3o. He does not e 
that Contemporary charitable policies shou 


» 2. па 
curtailed because they tend to undermine 
vidual initiative, 


ta 


eve 
be 


In terms of the ntent of the уна 
ables as shown by the Allport-Verno 
Scoring key for the Test of Values, ae 
tor B is heavily antipolitical and аа е 
economic. То а somewhat lesser degt? 
content scored as social, aesthetic, а 


PRIMARY PERSONAL VALUES OF THE ALLPORT-VERNON TEST 25 


theoretic is evident among the alterna- 
tives having positive correlation with 
Factor B. A number of the variables 
involving alternatives scored as reEgious 
have high loading on Factor B, rotably 
variables 38, 18, and 3. However, these 
would not, in the author's opinion, 
usually be considered indicative of reli- 
gious evaluative tendency. It is pertinent 
to note that none of these variables had 
Significant projections on first-order Fac- 
tor III, which had been interpreted as 
primarily antireligious in content. 

Factor B resembles Lurie’s Philistine 
factor (5). Detailed examination of the 
variables with high loadings on Factor 
В reveals no marked inconsistencies be- 
tween their content and the term Philis- 
tine. However, the author feels that 
Other designations are more appropriate 
and prefers to avoid the emotional tone 
of the term “Philistine.” 

Persons scoring high on Factor B may 
be characterized as idealistic, if the 
following restricted interpretation of the 
term is kept in mind. Idealistic, as we will 
use the term, characterizes individuals 
who evaluate highly concepts and beliefs 
which are aimed at the solution of the 
problem of the ideal social structure, the 
ideal manner of life, and who evaluate 
highly those aspects of our present day 
and of past cultures which they believe 
to be improvements over the usual, ac- 
cepted, or conventional set of values. 
In line with this tendency, the indi- 
vidual high on Factor B appears to 
evaluate contemplation more highly 
than direct action. This latter tendency 
is further evidenced in aesthetic pre- 
ferences that the more practical indi- 
Vidual would regard as esoteric, in- 
Volved, or “high brow.” 


It was indicated in for 
sion that items on the positive pole 


Were, according to the scoring key for 


egoing discus- 


the test, aesthetic, social, and theoretic 
in content. The comments in the pre- 
ceding paragraph suggest a reasonable 
hypothesis as to the common component 
in high evaluation of these apparently 
different types of content. The first two 
of these three types of content suggest 
idealism with respect to cultural develop- 
ment of the individual, and with respect 
to human relations and the structure of 
society. Idealism, as we use the term, 
is logically related to high evaluation of 
theoretic items, since speculation, cont 
templation, or theorizing is a necessary 
activity of individuals who concern 
themselves with "how things should be" 
rather than accept "things as they are." 
There is the further suggestion that indi- 
viduals scoring high on Factor B may 
evaluate more highly what they have 
acquired through the schools, through 
reading, and through contact with what 
might be termed cultural influences. 
They appear, in other words, to have 
been more heavily influenced by such 
aspects of our present-day culture than 
by the everyday world of practical affairs. 

Individuals who are low scoring or on 
the negative pole of Factor B are charac- 
terized in part by a tendency toward 
low evaluation of variables with social, 
aesthetic, and theoretic content. Such 
individuals appear to be unconcerned 
with the problem of “how things should 
be" but accept the “things as they are" 
and evaluate favorably those things 
which are related to effective action 
within the framework of the accepted 
set of values of the dominant “ме 
group” of our present-day culture. On 
a somewhat more tenuous basis, the 
author suggests that the low-scoring indi- 
viduals, because they accept “things as 
they are” and are concerned with effec- 
tive action within this framework, react 
with antagonism, lack of patience, lack 
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of understanding, or disparagement 
toward refusal to accept "things as they 
are." 


The foregoing comments suggest the desirabil- 
ity of a bipolar designation for Factor B. Since 
a factor is a single dimension, the need for a 
bipolar type of description requires justification. 
In normal interpretation of factors it is assumed 
that individuals scoring low lack characteristics 
possesed to a greater degree by individuals 
scoring higher. With a bipolar description it is 
implied that individuals high on the factor are 
characterized by evaluative tendencies absent 
in those scoring low and conversely that those 

® scoring low are characterized by evaluative ten- 
dencies absent in those scoring high on the 
factor. The author believes that the bipolar na- 
ture of Factor B results from the interaction 
ОЁ social groups with which the “Philistine” 
and “idealist” identify themselves—mutual dis- 
paragement tends to develop, Individuals possess- 
ing the characteristics of the high- or low-scoring 
group tend in consequence not to possess the 
evaluative tendencies characterizing those at 
the opposite pole. 

As an additional Point we might note that 
the content of the variables with high loading 
on Factor B suggests the presence of Withdrawal 
tendencies on the part of both high- and low- 
scoring individuals. The high-scoring individuals 
appear to show tendenci 
from active Participation in th 


other hand, individual i 
B appear to show wit! Y "cultural" 


in both instances to de- 
nt withdrawal is evidence 


„рте more highly evaluated 
activities or whether actual withdrawal is indi- 


Whatever its exact nature, the author 
believes that Factor B is a 


Source of variance їп the 
ments of human beings and that its 
significance carries over 

beyond that of value judg 
dence in support of this statement may 
be found in the table of intercorrelation 
of occupational interest scores published 
by E. K. Strong (6). In this intercorrela- 
tion table, a cluster of occupational 
scores fitting the general definitions of 


n important 
value judg- 


into areas 
ments, Evi. 


the two poles of Factor B can be reati] 
selected. Equivalents of the positive ge 
may be found in scores for цай апы 
ian, £rtist, and the sciences. On the nega 
tive pole such occupations as ee 
manager and banker are to be mE 
The average intercorrelation within en 
positive cluster is .74, within the -— 
at the negative pole .66, while the a 
age between-cluster correlation is p » 
These data provide additional € 
tion of the bipolar nature of Factor Sé 
and add emphasis to the statement ie 
made regarding the general e FE 
of the dimension defined by Factor / a 

The bipolar designation “тавана 
vs. "Practicality" will serve to identity 
Factor В. 


Second-Order Factor C: Religiosity 


$ hat 
Variable 532: Loading, .83. He believes UP 
one should Buide one's conduct according ! A i- 
develop one's chief loyalties toward, OE li o 
gious faith; rather than toward one's ne 
beauty, one's business organizations and 2 
ates, society as a whole, еа in а 
Variable до Loading, .81. If he livec come 
small town and had more than enough ү en- 
for his needs, he would prefer to use A rather 
dow the church to which he belongs elop- 
than apply it productively to industrial 1 pmen 
ment, give it to a university for the develop itals- 
of scientific research, or devote it to nosh sible 
Variable 2621 Loading, .72. Taking Ше. as 
as a whole, he would prefer to regard 1 point 
Spiritual revelation rather than from стату 
ОЁ view of its beautiful mythology and 
style, И refer 
Variable 9. Loading, „уу. He anao P To 
to read the headlines “Protestant Lea «Great 
Consult On Reconciliation” rather than 
Improvements In Market Conditions. not be 
Variable 132% Loading, 55. He docs artially 
lieve that the evidence that has been e has 
accumulated goes to show that the ie wi 
evolved to its present state in accor da need 
mechanistic principles, so that there is ү God 
10 assume a first cause, cosmic purpose, 
behind it, а like (0 
Variable 5921 Loading, 41. Не woul Supp 
think of Leonardo da Vinci's “The Last 
eS joadin’ 
“Both statement and sign of factor 
have been reversed. 
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as expressing the highest spiritual tendencies 
and emotions; rather than as one of the most 
priceless and irreplaceable pictures ever painted, 
in relation to Leonardo's versatility and its place 
in history or as a masterpiece of design. . 
Variable 55. Loading, .(1. Florence Nightin- 


* gale interests and attracts him more thun Na- 


poleon, Henry Ford, or Charles Darwin. 

Variable 54." Loading, .4o. He believes that 
one should guide one's conduct according to, or 
develop one's chief loyalties toward, one's re- 
ligious faith, one's business organizations and 
associates, or society as a whole; rather than 
toward one’s ideal of beauty. 

Variable 32. Loading, .39: He believes that 
good government should aim at more aid for 
the poor, sick, and old, the introduction of more 
ethical principles into its policies and diplomacy, 
the establishment of a position of prestige and 
Tespect among nations; rather than the develop- 
ment of manufacturing and trade. 

Variable 42." Loading, .39. When he goes to 
the theatre, he enjoys most, as a rule, plays that 
treat the lives of great men, plays with a theme 
of human suffering and love, or problem plays 
that argue consistently for some point of view; 
rather than ballet or similar imaginative per- 
formances. 

Variable 242% Loading, .39. He feels that the 
»world would be a much better place if we took 
to heart the teaching, “Lay not up for yourselves 
treasures upon earth . . . but lay up for your- 
selves treasures in heaven, where neither moth 
Nor rust doth corrupt, and where thieves do not 
break through nor steal.” 

Variable 16." Loading, .38. At an exposition 
he prefers to sce automobiles rather than scien- 
tific apparatus or chemical products. 

Variable 212" Loading, .36. He feels that the 
aim of the churches at the present time should 
be to convey spiritual worship and a sense of 
communion with the highest; rather than to 
bring out charitable tendencies and to urge 
people to think of the good of others. 

Variable 49." Loading, .36. During his next 
Summer vacation he would prefer to stay in 
Some secluded part of the country where he 
could appreciate fine scenery, go in for a local 
tennis or other athletic tournament, or get 
experience in some new line of business; rather 
than to write and publish an original biographi- 
cal essay or article. 

Variable 28.! Loading, .36. 
choose a topic on which to write 
Would choose the role of church-goin 
Tather than the defects of our presen 
tional systems. 

Variable 18. Loading, .34- He would prefer 
to hear a series of lectures on the comparative 
development of the great religious faiths rather 
than on the comparative merits of the forms of 


If he were to 
an essay, he 
g in religion 
t educa- 


government in Britain and in the United States. 

Variable 11." Loading, .34. When he visits a 
cathedral, he is more impressed by a prevading 
sense of reverence and worship than by the 
architectural features and stained glass. 

Variable 10." Loading, .31. He would prefer 
to read the story “Threat to Constitutional Gov- 
ernment in Germany by a Dictator” rather than 
“Physicists Make Important Discoveries Con- 
cerning the Structure of the Atom.” 


From Table 6 it will be noted that 
Factor C has its heaviest saturation in 
Factors IV and VI, the “antireligious” 
and the “humanitarian” factors. Ex- 
amination of the above listing of the» 
particular items or variables which have 
the highest loading on Factor С indi- 
cates that with the exception of Vari- 
ables 34 and 35, most of the variables 
having high loading on Factor С also 
have high loading on Factor IV and 
appear to be religious in nature. The 
relation of Variable 34 to religious evalu- 
ative tendency is fairly obvious. In the 
case of Variable 58, which has marginal 
loading, the alternative, “fundamentally 
spiritual in her attitude toward life,” 
very probably accounts for its loading 
on Factor C. 

While Factor С appears to be reli- 
gious in nature, the exact nature of the 
religious evaluative component involved 
and the exact manner in which it dif- 
fers from Factor IV is not directly evi- 
dent. 

It appeared plausible to the author 
that Factor C would disappear or reduce 
to a factor of rather narrow content if 
Factor II and other of the first-order 
factors were rotated in an appropriate 
manner. A technique for accomplishing 
these rotations without successive re- 
computation of and refactoring of the 
intercorrelations of the primaries is not, 
to the author's knowledge, available. 


D. Discussion 
In comparing the over-all results of 
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the factor analysis here reported with 
the purported content of the six scores 
for the Allport-Vernon test several points 
are evident. Aesthetic, antireligious, 
theoretic, and social factors resembling 
the original scores on the test were iden- 
tified. Common factors with content 
having reasonably close resemblance to 
that of the economic and political scor- 
ing keys failed to appear. Items in these 
two evaluative scores are, however, prom- 
inent in the second-order general Fac- 
etor B. Thus, it might be said that four 
of the evaluative scores give estimates of 
important factors resulting from the 
present analysis, and that the fifth and 
sixth may be combined to give an esti- 
mate of a single factor. However, each 
of the groups of items in the four scoring 
keys which resemble factors resulting 
from this analysis was split into at 
least two factors. For example, in addi- 
tion to the general aesthetic factor, an 
“Interest in Fine Arts” primary trait 
was isolated; a factor labeled “Interest 
in Culture,” involving a number of 
religious items, was isolated in addition 
to the antireligious factor; 
in Physical Sciences’ factor 
in addition to the theoretic 
while the analysis resulted in factors 
having agreement with the scores of the 
test, it must also be Stressed that the 
test scores are not factorially pure, but 
must be considered as an average of one 
factor accounting for a large Proportion 
of its variance, and one or more addi- 


tional but usually less important fac. 
tors.!? 


an "Interest 
was obtained 
factor. Thus, 


In general 


» there was closer agreement with 
the scoring k 


cy of the test than with the results 


* This comparison of the 
the content of the scoring 
some qualification, since two alternatives of 
each of fifteen four-choice items in Part II of 
the Allport-Vernon test were not included in 
the analysis, 


factor content with 
keys is subject to 
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< 
of Lurie'svanalysis. The identification of afa 
eral factor heavily involving both the po how- 
and economic evaluative tendencies was, d 
ever, a common finding of both analyses, W iE 
was inconsistent with the content of me ор 
keys. ‘The absence in Lurie’s analysis x d Sie 
eral aesthetic factor was the most ma nalyses 
crepancy between the results of the two a results 
although a reinterpretation of nm Durie 
did suggest that one of the factors whic table 
isolated but did not identify showed appt of the 
resemblance to the general aesthetic goo to ВЕ 
present analysis. While there might HET om 
considerable superficial resemblance actors 
Lurie’s social and theoretic factors and carinas 
VI and IX of the present analysis, close m the 
tion of the component variables loaded imilar 
factors indicated few identical or high 5 ntity 
variables and little basis for assuming ido fac- 
of these two pairs of factors. Of thc RE mately 
tors in the two analyses having арр ctor’ 
synonymous names, only the D e with 
found in the two analyses may be S es In 
assurance as closely resembling each О ber 0! 
addition, there were a considerable num 


А e 
H А fear оаа im L5 
primary evaluative tendencies нше. over 
present analysis with some confider , 
and above those identified by Lurie. in 


The fact that Lurie constructed а directly 
which evaluative tendency was stated ‘eval 
rather than in relation to other possible © 
tive tendencies may account in part though 
differences in results, In addition, ne con- 
Lurie's test was intended to duplicate s ap- 
tent of the Allport-Vernon test, there ] as in 
predable difference in content as um ] items 
form. Lurie's practice of adding diei 
to obtain a single variable probably am and 
the factorial complexity of his varia e par 
may have been a still additional facto results 
Tesponsible for differences between the 


cent 
А presen 
of his analysis and those reported in the I 
Paper, 


me 
The general nature of the ne 
traits as they were isolated ап ort 
terpreted in this paper does not supt in- 
Spranger’s theory of evaluative OY оте 
Sofar, at least, as the test scores f the 
formed to that theory. An aspect 0 tors 
interpretation of a number of = on 
isolated is pertinent to this р, In 
Will bear emphasis in its own rig ed re 
interpreting several of the wee ар" 
sulting from the present analysis, tions 
peared that the beliefs and ка 
stated in variables with high 1096"? 


LR 


з. 


4 


PRIMARY PERSONAL VALUES OF THE ALLPORT-VERNON TEST 29 


x 
were most readily interpretable as char- 
acterizing a particular „social group or 
institution. It seemed quite clear, for 
example, that a high or low score on 
Factor IV (antireligious) depends upon 
disagreement or agreement with the con- 
ventional religious beliefs of the Chris- 
tian church. Factor VII seemed readily 
interpretable as an “Interest in Science" 
factor. If we regard science as an institu- 
tion, differences between individuals 
scoring high and low on Factor VII can 
be ascribed to differences in their inter- 
est in or evaluation of science as an 
institution. Again, Factor X ("Rugged 
Individualism") appeared due to indi- 
vidual differences in acceptance or re- 
jection of the evaluations inherent in 
the American tradition of rugged indi- 
vidualism. 

Factor B, the most prominent in terms 
of the proportion of common variance 
accounted for, was interpreted as repre- 
senting the divergent viewpoints of the 
idealist and the practical man. It was 
postulated further that the apparent bi- 
polar nature of the factor is related to 
formation of opposing "we groups" and 
resulting conflict between them. While 
instance the social structures 


in this 
postulated are not formal or institution- 
alized, it is believed that this interpreta- 
tion of Factor D, if correct, supports the 
generalization stated above regarding the 
importance of social groups in under- 
standing and interpreting the obtained 
factor structure. 


VI. SUMMARY 


The Allport-Vernon test, “A Study of 
Values,” was administered to 200 col- 
lege students. Tetrachoric intercorrela- 
tions of 6o of the items were computed, 
and cleven centroid factors were ех- 
tracted and rotated to an oblique simple 
Structure. Three second-order general 


factors were determined from the inter- 
correlations of the oblique factors, and 
the loadings of the tests on the second- 
order factors computed. 

The first-order factors described below 
were identified with varying degree of 
confidence. 


Factor I. General Aesthetic Interest 


Factor I is a general aesthetic factor 
which corresponds rather closely to the 
aesthetic measure obtained through the 
scoring key of the Test of Values. 


Factor II. Interest in the Fine Arts 


Factor II is less well established and 
less general than Factor I. It appears to 
involve group-held evaluations of the 
artistically inclined. The content seems 
restricted to the fine arts. 


Factor Ш. Belief in “Culture” 


Persons scoring high on Factor III can 
be characterized by a desire to appear 
“cultured.” Their evaluations appear to 
have been determined by processes that 
might be described as intuitive or mysti- 
cal, The content of items having positive 
correlation with Factor III tends not to 
involve apparent economic, biological, 
or social needs. 


Factor IV. Antireligious Evaluative 
Tendency 


Factor IV appeared to be definitely 
identifiable as antireligious in nature. 
Differences in reaction toward the con- 
ventional creed or indoctrination of the 
Christian church as an institution were 
postulated as the basis for the variance 


accounted for by Factor IV. 
Factor V. Antiaggression 


Factor V apparently has to do with 
individual differences in interests or 
cvaluations relating to confiict, possibly 
to armed conflict in particular. 
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Factor VI. Humanitarian Tendency 


The items of the Test of Values scored 
as social were well represented among 
those having high loading on Factor VI. 
Since the items highly loaded on Factor 
VI were largely concerned with social 
issues, the interpretation of Factor VI 
simply as “social” was not adequate. The 
personal or face-to-face social interests 
which appear to have been postulated in 
many of the items scored as social did 

. not appear to be prominent in the con- 
^tent with high loading on Factor VI. A 
sympathetic or humanitarian rather 
than a rational basis for such interests 
in social issues seemed implied by the 


variables with high loading on Factor 
VI. 


Factor VII. Interest in Science 


Factor VII seemed definitely related to 
high evaluation of, or interest, in, the 
physical sciences. 


Factor VIII. Tendency toward 
Liberalism д^ 


Factor VIII resembled Factor VI in 
many respects. Persons high on Factor 
VIII, however, seemed characterized by 
à liberal viewpoint on Social issues which 


seemed to be intellectual rather than 
emotional in origin. 


Factor IX. Theoretic Interest 


Factor IX seemed to 
closely to the Conception o 
Interest. indicated by Spran 
tion as evidenced in the sco; 
the Test of Values, It shou 


correspond 
Е theoretic 
ger’s defini- 
ting key for 
Id be noted, 
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+ . Au > 1 
though, that items dealing with socia 
ere 4 k re 
issues and with interest in science ме 
г 
not highly loaded on Factor IX. 


Faütor X. “Rugged Individualism” 
Tertatively, individual differences E 
acceptance or rejection of the Auer 
tradition of "rugged individualism WE т 
postulated as the source of the varianc 
accounted for by Factor X. : of 
The meaningful interpretation à 
Factor XI was attempted. It was as 
sumed to be residual in nature. " 
Of the three second-order factors 1807 
lated, Factor 4 did not account "E 
large proportion of the variance of aa 
original matrix and was not шерге) 
while Factor C seemed too similar | е 
first-order Factor IV to add to the v 
terpretation of the primary атн 
tendencies as described by the first-0! | 
factors. Factor В, on the other han t 
appeared to be the most importa 
source of variance in evaluative tenden 
cies revealed by the analysis. Factor à 
Was interpreted as a basic source ive 
individual differences in evaluat п 
tendencies which differentiated Бе ne 
idealism on the positive pole and у 
cality on the negative pole. The t in- 
“idealism” was used to describe an on- 
terest in, and high evaluation of, € 


i ith im 
cepts and beliefs concerned wit! 4n 
a 


this framework. 


Г? 
f 


PRIMARY PERSONAL VALUES OF THE ALLPORT-VERNON TEST 31 
REFERENCES 

1. ALLPORT, G. W., & VERNON, P. E. A study neurotic tendencies. Psychometrika, 1937, 
of values. Boston: Houghton Mifflin, 1931. 2, 263-387. 

2. Durry, ELIZABETH, & Crissy, W. J. E. "valua- 5. LURIE, W. A. A study of Spranger' value 
tive attitudes as related to vocational in- types by the method of factor analysis. 
terests and academic achievement. J. J. soc. Psychol., 1937, 8, 17-37. 
abnorm, soc. Psychol, 1940, 35, 220-245. 6. STRONG, E. К. Manual for Vocational Interest 

3. Сипғово, J. P. Personality factors S, E, and Blank for Men. Stanford Univer.: Stanford 
M and their measurement. J. Psychol, Univer. Press, 1945. 

1936, 2, 109-127 7. VERNON, P. E., < ALLPORT, С. W. A test for 

4. Moster, С, 1. A factor analysis of certain personal values. J. abnorm. soc. Psychol., 


1931, 26, 231-248. 


Accepted for publication, March 13, 1952. 


; 
| 


-— 


Vol. 66, No. 17 


Whole No. 349, 1952 


Psychological Monographs: General and Applied 


S 


о 


а] . o, . 
Selected Personality Variables and the Learning Process 


Eugene L. Gaier* 
University of Illinois 


I. INTRODUCTION 


Changes in overt behavior or verbal 
performance following practice with 
Some verbal or motor task have gen- 
erally been considered as evidence of 
learning. These changes of behavior 
have been primarily investigated from 
two approaches: (a) studying the result- 
ant changed behavior; and (b) studying 
the processes leading to the observed 
changes in behavior. While both of these 
?pproaches are essential, they must be 
lelated to a third variable: the nature 
of the individual involved in the task. 
It is in the light of the needed research 
in the relationship between the learning 
Situation and the personality of the 
learner that the present study has been 
Initiated. 

We are here making the initial as- 
sumption that certain relatively stable 
personality characteristics exist which are 
reflected in the individual's handling of 
the learning situation. Freud asserted 
that the thinking processes were con- 


a dissertation sub- 
of the Department 
f Social Sciences 
partial fulfill- 
he degree of 


? This study is a revision of 
mitted in 1951 to the faculty 
of Psychology in the Division o 
of the University of Chicago in 
ment of the requirements for tl 
Doctor of Philosophy. А 

To Dr. Benjamin S. Bloom, under whose di- 
rection this study evolved, the writer is indebted 
for helpful suggestions, critical judgments, and 
Encouragement. The writer also wishes to ex- 
Press appreciation to Dr. „Ernest A. Haggard 
and Dr, Donald W. Fiske for their stimulating 


ir 
terest and counsel. 


veyors of underlying feelings, and that 
there seemed to be a definite connection 
between the thought processes and the 
other processes occurring simultaneously 
within the individual. This position has 
been taken for the present investigation, 
which aims to demonstrate the relation- 
ship between the individual's kinds of 
thinking and selected. personality char- 
acteristics. 

In an attempt to get at the manner in 
which the individual's personality char- 
acteristics àre manifested in the learning 
situation, the present study is designed 
to investigate the relationships between 
the recalled verbalizations of associations 
experienced in a series of learning situ- 
ations over a period of four months by 
a group of college students in the Uni- 
versity of Chicago, and personality char- 
acteristics as inferred from test protocols 
of the Rorschach ink blot test. The spe- 
cific questions we were here interested 
in investigating were: 

1. What is the relationship between 
selected personality characteristics (viz., 
anxiety, rigidity, negativism) and the 
kinds of thoughts a group of college stu- 
dents have in a series of learning situ- 
ations? 

о. What is the relationship between 
ed personality characteristics. and 


select 
where such prod- 


products of learning, 
ucts can be inferred from test perform- 


ance? 
Many investigations have attempted to 
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formulate concepts linking levels of in- 
dividual functioning conceived as parts 
of one process. Research in social psy- 
chology and perception has indicated 
clear relationships between perception 
and personality. The present study is 
a departure from these lines insofar as 
mental processes going beyond immedi- 
ate perceptions are studied objectively in 
an effort to understand how they relate 
to some general and stable personality 
characteristics. Here we are attempting 
to investigate the relationship between 
the more highly cognitive ability of prob- 
lem solving and personality character- 
istics. 


IL THE METHOD OF 
STIMULATED RECALL 


A. BACKGROUND 


The class situation is a process con- 
sisting of overt, observable behaviors or 
activities and nonovert behaviors or pri- 
vate experiences of both the teacher and 
the students which defy observation. 
Until the present, the major source of 
evidence for studies of classroom learn- 
ing and procedures has been the investi- 
gation of the overt behaviors. Where 
mental processes of students have been 
considered, they have been assumed or 
inferred from the overt behaviors. Those 
who propose theories about learning 
acknowledge that some kinds of mental 
activities, as well as physical activities, 
are involved in the learning process. The 
physical activities are presumably ac. 
companied by certain conscious and un- 
conscious activities, The techniques for 
obtaining evidence of learning, however, 
are limited by current methods to data 
of physical activities, i.e., overt, observ- 
able behaviors. The conscious and un- 
conscious mental activities regarded im- 
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portant for learning are less readily ob- 
servable. 

The extent to which mental processes 
can. be inferred from overt behavior 35 
limited since specific behaviors are not 
necessarily accompanied by the к 
mental processes in different individua s 
Any attempt to infer the mental prot 
esses from observations of overt behavior 
is subject to much error, since а d 
of mental processes may lead to the Su 
end product. And unless additional p 
dence is gained about the processes m 
volved, the investigator cannot be c 
tain of his inferences. 


er- 


while participating in an acti 
this upon the completion of the task. ngag 
(19) had his subjects think aloud while CNS © 
in problem solving. Often, the process 
ing one’s own thinking affected the Ve investi 
iors the experimenter was interested 1n i nc 
gating. The attempts to obtain evidence ati 
conscious processes by asking particip? iven 
report and record their thoughts during "159m 
Situation have not been very successful. sycho- 
(1) noted that it was not feasible to have poy an 
logically naive subjects both participate y par 
activity and simultaneously observe vue 
ticipation, On the other hand, if psych? counts 
trained subjects are to give introspective p* 
as they participate in an activity, theii, pender 
and psychological sophistication was com 
them poor subjects for investigating 2895 pject 
plex social situations such as learning а * 

at the college freshman level. 


troduced by Bloom (1), 
technique for attempting tO 
conscious thoughts of the 
Basically, this is a technique W 
tempts to get at the conscious г 


м А ‚Ауана 
ideas, and experiences ап indiv! 


oc 
d E à is meth 
had in a learning situation. This с give" 
is based on the assumption thé 


ipe «ational 
enough of the original situatio 


get 2 
indiv! 
hich 


" 
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terial (i.e. cues from the class session), 
the individual will be stimulated to re- 
call not only the original overt activity 
(Le., the verbal and physical behaviors 
of the class situation) but his own^pri- 
vate experiences as well. Sound retord- 
ings made of the class discussion are 
played back to the participant in an at- 
tempt to stimulate recall of his thoughts. 
It is these recalled and reported experi- 
ences that become the data obtained 
with this technique. No special training 
is required for the subjects to recall and 
report their thinking. This participant- 
observer method, unlike introspection, 
permits full, unhampered, and free par- 
ticipation of the subjects during the 
original situation. Thus, the individual 
becomes both the participant and the 
observer. 

The method of stimulated recall lends 
itself not only to providing reports of the 
thental activity occurring concurrently 
with certain overt activities, but also in 
making comparisons of all members of 
any situation at a defined period. This 
method is applicable to group situations 
in which there are many participants 
and where considerable overt verbal ac- 
tivity occurs. It is assumed that the sound 
record will provide sufficient cues of the 
original situation for the participant to 
recall his experiences. Within a 48-hour 
period following the original situation, 
each participant of the group is indi- 
vidually interviewed and the sound rec- 
ord is played back to him. At specific, 
preselected points in the discussion, 
called Critical Points, the recording is 
Stopped and the subject is asked to re- 
call and report the thoughts he experi- 
enced in the situation at this particular 
Portion. The reports given at the stops 
of the recording provide evidence of the 
Conscious processes. 


III. THE COLLECTION 
OF THE DATA 


A. THE COLLEGE AS A 
LEARNING CONTEXT 


Education in the College of the Uni- 
versity of Chicago is based on the idea 
that the students take general courses in 
several major areas, with work presented 
principally through small discussion 
classes. Supervision of the student's work 
is considerably less than in high school. 
A student's standing is measured solely 
by performance on comprehensive ex- 
aminations given at the end of the 
school year, rather than by such indices 
as class attendance, teacher grades, or 
teacher-constructed tests given during 
the year. 

At entrance, records of previous aca- 
demic work are not considered in deter- : 
mining the student’s course placement. 
The need Tor standard measures of com- 
petence, in view of the variety of back- 
grounds of the students, has led to the 
placement-examination program. While 
school records provide some indication 
of previous training, a list of credits is 
often an inadequate basis for deter- 
mining the point at which the student 
is prepared to begin his studies in the 
College. Some entering students have 
completed but ten grades of schooling, 
while others have had several semesters 
of college work. The development of 
these placement examinations has served 
to indicate the level of courses and the 
of courses to be taken by the 


number 
erms of his particular 


applicant, in t 
academic needs. 

At the outset, it must be pointed out 
that the subjects used in this investiga- 
tion, if representative of the University 
of Chicago College entrants, are not 


representative of the usual college fresh- 
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man. As noted by Cronbach (4), they are 
intellectually extremely superior and 
have special motivations which cause 
them to seek out the Chicago program. 
The context in which the entering Col- 
lege student finds himself is one of in- 
tellectually superior and aggressive stu- 
dents with high motivation and a keen 
sense of competition. Every attempt. is 
made to meet the individual's intellec- 
tual needs and abilities, both in the 
initial screening of applicants and in the 
placement of the admitted students in 
the course. It is within this type of con- 
text that the present subjects were drawn 
and the study was conducted. 


B. THE SUBJECTS 


The subjects for this investigation 
consisted of members of one intact Social 
Science I class of 11 students, registered 
for the first time in the College of the 
University of Chicago. These’ з female 
and 8 male students ranged in age from 

5 to 22 years. These subjects were 
simultaneously registered іп either 
Mathematics I or Humanities I, in addi- 
tion to the Social Science I course, This 
class in Social Science, selected as the 
parent course, was chosen because of the 
degree of involvement afforded the stu- 
dent by the subject matter presented 
therein. The range of materials covered 
contains strong implications for ey 
day life beyond the college situ 
serving to arouse a greater sphere of 
thinking related to personal values and 
attitudes. The topics covered Succeed in 
involving the students in а manner not 
usually possible with Subject matter 
such as mathematics, chemistry, ог a 
foreign language. 


ery- 
ation, 


C. PROCEDURES IN Data COLLECTION 


We were interested in determining 
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the manner in which selected personality 
characteristics are manifested and erir 
ployed in varying types of learning m 
ations. The present investigation is basec 
on three types of data: (a) the peg 
thoughts or ideas experienced n 5A 
classroom and reported in individua: 
interviews over a period of four fs 
(b) ratings of Rorschach test protoco K 
and (c) performance results on ace 
ment and aptitude tests given colleg 
students. 


1. The Consciqus Ideas 


In order to familiarize each class ең 
the presence of the recording ы 
ment and the investigator, eae 
class recordings were made. Prior to m- 
initial recording, each of the 11 е 
bers from the class selected for study “ w 
individually interviewed in an attemp” | 
secure his cooperation for this peri 
Each student was informed that а 57 а 
of individual interviews would er 
necessary part of the investigation, ths. 
would extend over a period of 4 pe ter- 
At the time of the initial contact 1” 


s 
А Я „med as 
view, the students were not inforn 


to the nature of the interviews that ane 
be conducted. Each person interview 
consented to participate in the in 
tion. 


vestig" 


rded for 


Each class studied was reco the 
rom 


the full 50-minute session. F py stu 
class discussion, statements made ' |, ар 
;hic 
dents or read from the text whi Ive 
p invo 


peared to have the most grou ritica 
as С 


ment were selected to serve as | ns (0 
points during the interview pert 
stimulate the recall of the o select 
thoughts. An attempt was made (0 lent 
those class materials that would eal 
themselves to maximum personal e the 
ing and involvement on the part pe 
students, as well as to include тапу d 
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of classroom verbalizations in the 10 to 
15 statements or phrases selected from 
each clas. No method, however, was 
devised for a random sampling of these 
statements,” 

Within a 48-hour period of the class 
recording, each subject was individually 
Interviewed. At the beginning of the 
first interview, the following directions 
were given each subject: 


tome has been interested in studying 
Eg ө ү teaching and class procedures used 
. € past, recordings of the class sessions 
have been made and studied in great detail to 
enable the instructors to become more sensi- 
tive to their own teaching methods. Now, in 
addition, we are interested in investigating the 
kinds of things that students think about during 
the class discussion. j 
{ The method that we are making use of here 
15 to play back the recorded session of the 
class in which you participated this morning 
[yesterday or this afternoon]. The record which 
І have here will be played back to you in order 
to help you recall the thoughts and ideas you 
had while the class was going on. This is similar 
to asking you to recall your tenth or twelfth 
birthday if I should tell you about the gifts 
you received or the songs that the guests sang 
to you, 

It is unlikely that you will be able to recall 
Very much at first, but as the recording of this 
Class is played back to you, and as you get more 
of the feeling for the class session, you should 
be able to recall more and more of your class- 
Toom thoughts. 

As the recording is pl 
Stop it from time to time at cert 
I shall ask you to recall what you were 
about during the original situation. 
to recall and 1elate any experiences or ideas yc 
had in the class situation, no matter how trivial 
Or irrelevant you may feel them to be. 

If you recall any ideas or experiences you had 
during selections of the recording at which I 
do not stop, tell me, and I shall stop the re- 
corder. Anything that you tel] те will be 
recorded verbatim, This information will be 
held in confidence, and will not be shown to 
—— 
ba The proportions of the v 
~Shaviors selected for presen 
jects, however, were approximately the 

© random sample selected from the 
the entire study, determined by selectir 
Ourth statement throughout the entire type- 


Scri 3 
"Ipts of the recordings. 


ayed back to you, I shall 
c ain points, and 
thinking 
Feel free 
ou 


arious overt verbal 
tation to the sub- 
same as 


data for 
ng every 


any of your instructors or used in any way to 
evaluate your work here in the College. Have 
you any questions before we begin? 

The verbatim reports of the experi- 
ences and ideas recalled at the given 
critical points of the subjects provided 
the major portions of the data for the 
present investigation. Henceforth, these 
recorded reports will be referred to as 
the conscious experiences or conscious 
ideas. A sample of 107 overt critical 
points was used at which the subjects 
were questioned for their recall of class 
experiences. This total included 77 pre- 
selected points, and 3o points at which 
the subjects volunteered their experi- 
ences. A total of 2166 conscious idea 
units was reported. Of this amount, 1937 
units were actually experienced in the 
class situation, and 229 units were volun- 
teered as a function of the interview 


situation. 
o 


». The Projective Test 

Each of the 11 subjects was individu- 
ally administered the Rorschach ink 
blot test during the last month of the 
investigation period. Test administra- 
tion was delayed until all of the inter- 
views had been secured, since it was felt 
that the unstructured nature of the 
Rorschach, plus the common misunder- 
standings of the nature of the ink blot 
series, might arouse resistance and possi- 
bly serve to terminate the interviews, 
vitiating our original design. The rat- 
ings of various dimensions of personality 
inferred from the Rorschach constitute 
our second source of data. 


3. Test Situational Data 


Entrance Tests. Each College applicant 
is given a series of entrance tests consist- 
‘no of the American Council оп Edu- 


in 
cation Psychological Test (ACE), a Read- 


ing, and a Writing Achievement test. 
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Evidence gathered over a period of years 
has indicated the value of these tests for 
predicting success in the College; and 
the test scores constitute part of the 
information used in admitting appli- 
` cants. 
Placement Examinations. Upon being 
admitted to the College, each student 
is given a series of placement examina- 
tions. These tests are planned to measure 
skills in reading, interpretation, and the 
solving of problems, as well as general 
` subject-matter knowledge. The results 
of this series of tests, covering all areas 
of college work, are used as an index 
for placing students in the courses geared 
to individual needs and abilities. On the 
basis of placement-test achievement, stu- 
dents may be classified in four 


groups 
in each subject field: 

a. Those who have com 
that called for by 
examination and а 
the examination. 

b. Those who have mastered а certain por- 
tion of the knowledge and skills covered in a 
comprehensive examination and are advised, 
therefore, to take only a part of the Course 
Offered in preparation of the examination. 

с. Those who have not acquired sufficient un- 
derstanding and skills to Pass a particular com- 
prehensive examination without first taking the 
entire course in preparation for the examina- 
tion. 


d. Those who are lik 
ination unless they 
addition to the prep 
the course. 


petence equivalent to 
a particular comprehensive 
re excused, therefore, from 


ely to fail in their exam- 
receive special training in 
aration regularly offered in 


The performance of all of the 11 sub- 
jects on the examination fell into Cate- 
gory c. Because the 
sufficient understand 
the pl 


y had not acquired 
ing and skills to pass 
acement examination (Le, and 
8o on to the next course in the Social 
Science sequence), this is assumed rela- 
tively constant for the group. 

College "Achievement. The use of the 
ACE provides some index of potential 
ability the student brings with him upon 
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entrance, as well as some basis for the pre- 
diction of his subsequent school success. 
The placement examinations provide a 
measure of achievement at the time of 
entrance. The third type of data obr 
tained was individual performance on 
the Social Science I Comprehensive Ex- 
amination. This comprehensive exami- 
nation, constructed by a central coin 
mittee, is given at the end of the year. 
The examiners work closely with the 
instructors in the preparation of the BV 
but the final form of the examination Г 
prepared by the central canine ои 
examiners. Final grading is made Wit ^ 
out knowledge of the identity of the 
writer of the paper, to minimize bias. 1 

The cómprehensive examinations a 
composed of a series of parts ee 
to tap a variety of behaviors and ski 
that meet the objectives of the бк 
It is recognized that the single grade 
given the student for achievement on the 
examination does not adequately as 
scribe his performance, since it is p 
likely that performance is consistent 
at the same level throughout the vaun 
processes tested. Some parts of the ja 
amination represent subject-matter hel 
visions and facts, while others call a 
the ability to analyze and organize g 
or familiar subject matter. The preas 
the Social Science I examination 
fully presented in Part IV. itu 

In summary, three kinds of test 5! ti- 
ational data were collected: one of dins 
tude (ACE) and two of achievement. york 
form of achievement is based on d ile 
previous to entering the College, W? z 
the comprehensive examination i5 ae 
Measure used after subjecting the из 
dent to a series of specific learning 
terials in a systematic fashion. 


4. The Rorschach Results ela- 
In our selection of the kinds of ™ 


are ` 


| 
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tively stable personality characteristics 
that would become manifest in the learn- 
ing situations, two criteria were em- 
ployed: о 

а. Can the personality characteristics, 
assumed to be stable, be inferred from 
the Rorschach records with sufficient 
reliability (at the 5 per cent level) by 
two judges? 

b. Can the kinds of personality charac- 
teristics previously studied and reported 
in the literature become manifested in 
the kinds of data obtained here? 

Among the personality characteristics 
studied in the literature have been (а) 
free floating anxiety; (b) negativism; (с) 
rigidity; and (d) aggression. It seemed of 
interest to attempt to relate these charac- 
teristics as evidenced on a projective 
test, with the indices of intelligence and 
accomplishment used here (ACE, achieve- 
ment tests, and grades). 

Rank-order correlations 
puted between ratings made independ- 
ently by two Rorschach experts. Use was 
made only of those ratings whose reli- 
ability coefficient? was .6o1 or over 
(significant at the 5 per cent level). The 
correlation between negativism and ag- 
gressiveness (.67) was high enough to 
lead us to believe that one may be but 
a facet of the other, and separate treat- 
ment would not add to the interpreta- 
tion of the data. The ratings made by 
the two experts were pooled, and were 
then assigned each subject. 


were com- 


5. The Conscious Behaviors 


A system of classification of the re- 
called conscious experiences was de- 
veloped for the present study. Each 
separate idea, in many instances a clause 
or phrase, served as the unit for classifi- 


* Spearman rank-order method. 


cation. This unit of division, here 
called the idea unit, was selected, since 
it appeared that a classification division 
based ‚оп the number of words spoken, 
or on all materials expressed at one 
critical point, would serve to obscure 
the richness of the obtained data. The 
need for this particular system* of classi- 
fication becomes clear when material 
such as the following is expressed at one 
critical point:? 


Donna:/ When I first heard of the survival 
of the fittest in biology class in high school and 
the Darwinian theory, well, I was thinking of 
this/ Thought I would like to learn more 
about all of this./ This expression surprised me, 
[or I never heard about the Judeo-Christian 
tradition. People usually just say "Christian 
Tradition."/ I was laughing at Jack's expression, 
"Someone tried to hit me over the head." I 
wasn't thinking about it, It just amused me./ 
I agreed with Mr. X— (the instructor). I 
wondered what the word "progeny" meant, and 
where he got it./ 


Where more than one discrete thought 
was reported at a particular point in 
the original situation, each idea was 
classified as a separate unit according to 
the method of division adopted here. 
It was the rare critical point that stimu- 
lated the recall of only one idea unit. 

In addition to the ideas actually ex- 

erienced in the actual class situation, 
the following kinds of thoughts and in- 
formation were reported:* 
immediately preceding 
the critical-point stop. This was usually pre- 
sented by the subject to give continuity: to the 
ideas expressed during the interview. 


1. Ideas experienced 


3 At best, the classification of any qualitative 
material is subject to some distortion once it 
has been removed from its original context. The 
classification title is but a convenient symbolic 
shorthand that lends itself to a more facile 
treatment of the data than would be the case if 
it were left in its original context. 

*'The unit division is indicated by a diagonal 
bar. 

© These were not used in the analy 
data reported here, however. 


sis of the 
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2. Explanatory remarks made in reporting the 
actually experienced ideas, These were usually 
given for the benefit of the interviewer. These 
ideas were recorded in a special way to take care 
of their source of stimulation as attributable 
to the interview situation itself. 

3. New ideas and associations which the indi- 
vidual experienced during the interview situa- 
tion. These comments usually arose as explana- 
tions, attitudes, or individual perceptions of 
classroom situations, the instructor or classmates’ 
behavior. Most common, however, were affective 
feelings of the self, and progress the individual 
felt that he had been making. 

4. Reports of the overt behavior or conscious 
experiences following those at the critical point. 


Source of Thought. Each idea unit was 
classified according to the stimulus or 
objective source of the idea, as inferred 
by the judges from the subject’s report. 
This classification dealing with the 
source of the idea units will, henceforth, 
be referred to as the Source of Thought. 

A tenfold classification was developed 
in an attempt to describe the sources of 
ideas during the actual classroom. proc- 
ess. This classification may be broken 
down into the degree of relevancy and 
desirability for classroom thinking: 

1. The highest degree of concentr; 
classroom would be problem-orient 


concerned with the topics of the educational 
experience. Herc, we would expect the source of 


thought to be the ideas directly under consid- 
cration. Included here 


ation in the 
ed thinking 


c were the categories: (a) 
ideas under consideration; and (b) a related 
idea. 


2. Just beyond the immediat 
may be found kinds of thinking not directly 
stimulated by the Problems discussed, Here the 
ideas stem from the course materials in (he 
form of reading in the text, looking through 
notes, or working problems, Included here Was: 
(с) activity related to the class or subject inde- 
pendent of the ideas directly under consideration, 

3. Not related to the class material, but still 
confined to the class situation, is the student's 
thinking about people in the classroom. The in. 
structor, classmates, and the self are all 
cluded here in the categories labeled: 
(e) teacher; and (f) another student in 1 

4. Thoughts stimulated by stimuli w 
class situation may include: 
sight or hearing; 
and/or process. 


€ subject matter 


in- 
(d) self; 
he class. 
ithin the 
(g) objects within 
and (h) classroom Situation 
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5. The student may introduce stimuli a em 
to the class process and ботоат, een 
are signs of distraction and diversion in me Ше 
experience and include: (i) someone not ч is 
classroom; and (j) some concrete object or s 
tion not in the immediate environment. о 

6. Fer units not appropriate to the ota fa 
areas, a special category entitled uncias 
was employed, 


Discomfort-Relief Quotient. А modifi- 
cation of the Discomfort-Relief Ошоо 
(DRQ) developed by Dollard Bae 
Mowrer (5) was employed for classifying 
this dimension of the experienced pec 
As a measure of progress in case work, 
these authors obtained the DRQ by 
having judges divide the transcripts S 
the protocols into clauses and enn 
units. Each unit was classified as an e: 
pression of discomfort, relief, or ке, 
affective tone, and the tension index Ма 
in the form of: 


Number of Units of Tension жее 
icf Units 


DRQ= .- —— nile - 
2 No. of Tension Units + No. of Rel 


К | ses set UP 

Methods of classification of units 5© ere 
н 

dea 


14у, 


by sentences, paragraphs, or pages " 
reported by these authors. But the ! 
unit, as adopted for the present stt 
Was reported as being most reliable mm 

On this basis, the following class! s 
tion was employed here: 

ion: 

1. Direct expression of relief, lowered tensio! 

Or satisfaction. 


: > ‚ rt, tens; 
2. Direct expression of discomfort, t 
annoyance, 


И т 
ion, 9 


nents of 
dis- 
ling 
two 


Clearly, the use of only staten к 
direct expressions of satisfaction OF 
Satisfaction would result in discare 
much of the data. Consequently, 1 
other categories were developed іо! 
clude units where по explicit enge" 
of affect existed: tis- 

3. Inferred relief, lowered tension, O" i 
faction, ance 


А n annoy 
4. Inferred discomfort, tension, or 4 


A 


SEL 


To account for units without affect or 
positive or negative tone, two additional 
categories were set up: 


5. Neutral 
6. Ambiguous and/or ambivalent. v 


Orientation of Thought. While many 
individuals may be aroused by the same 
stimulus (our Source of Thought classifi- 
cation), each individual may handle and 
treat these stimuli in differing ways. 
Some classification seemed desirable here 
to take into account the differing charac- 
teristics and treatments and orientations 
of the idea units reported. In this classifi- 
cation, henceforth to be referred to as the 
Orientation of Thought, no attempt was 
made to judge the quality or the ap- 
propriateness of the reported experi- 
ences. The basis for describing any con- 
tent was to be found in the idea unit. 

In brief, a classification believed to 
lend itself to describing the orientation 
of class experiences was developed. Four 
kinds of general content trends were 
evidenced in the obtained data: 


1. Active thinking or problem solving, indi- 
cating an actual awareness and comprehension 
or evaluation of the topics discussed. Included 
here were the categories (a) active participation; 
(b) evaluation; and (c) comprehension. 

2. Passive thinking about class topics, indicat- 
ing an awareness of the problem but not an 
active consideration. This category was labeled 
(d) passive participation. 

3. Under the broad heading of Diversions 
were included the reports of emotional reactions 
and attitudes about the self, other people, and 
class materials. Categories contained here were: 
(а) individuals and their characteristics; (b) 
ideas and words; and (c) concern about the 
self. 

4. Reports of class activities and conditions. 
This category was labeled (d) other activities. 


In addition, the classification of III. 
No recall was included to account for 
the failure by the subject to remember 
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the ideas experienced in the class at the 
preselected critical point. 

Each of the first eight general cate- 
gories of the above ninefold classifi- 
cation was subdivided. (See Appendix 
for a complete description.) Each idea 
unit, taken from the written typescript 
of the reported experiences, was classi- 
fied as to one kind of orientation of 
thought. f 

In the ordering of qualitative data, 
the danger of the classifier’s own bias ex- 
ists; and lack of awareness of this bias on 
the part of the investigator may serve to 
distort the results obtained. At the out- 
set of this investigation, in order to 
minimize classifier distortion, it seemed 
advisable to adopt a systematic bias in 
classifying the idea units both for Source 
of Thought and Orientation of 
Thought. The bias adopted was in the 
direction of the desirable learning in the 
college situation. In the ordering of the 
Units, a hierarchy extending from class- 
oriented thinking to individual-centered 
experiences was set up. Wherever a 
choice was possible between problem- 
oriented and self-oriented thinking, pref- 
erence was in the direction of the former. 


6. Objectivity of Classification 


The ability of other judges, in addi- 
tion to the investigator, to learn the 
present classification systems and to 
apply them in the same fashion was the 
basis for the criterion of objectivity 
used in evaluating the categories here 
developed. All interview protocols were 
divided into idea units independently 
by the investigator and one judge to 
obtain an index of objectivity of idea-unit 
division. In addition, all of the protocols 
were classified by two judges plus the in- 
vestigator for the Source of Thought, 
DRQ, and Orientation of Thought. 
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A practice session was held with each 
judge during which a random sample 
of idea units was coded. Differences in 
interpretation were then discussed in 
order to establish a common frame of 
reference among the judges and the 
investigator. Pearson product-moment 
correlations’? were computed between 
the classifications of the two judges. 

Agreement of Content Unit Division. 
All interview protocols were divided on 
the basis of the idea unit. Judgments 

" were to be based solely on the complete- 
ness of an idea per se. The agreement on 
unit division obtained between the 
judge and the investigator was 98 per 
cent. For the remaining 2 per cent of 
units in which there was disagreement, 
the judges met to reconcile the differ- 
ences. The high percentage of agree- 
ment obtained indicated sufficient ob- 
jectivity to allow us to proceed to the 
other classifications. 

Objectivity of the DRQ Category. 
Eleven interview protocols from one 
class were given to three judges with 
comparable psychological training, to 
make judgments of the modified DRQ. 
Two of the judges were instr tc 
make their judgments on the 
deliberate exclusion of 
psychological significance or implications 
of the responses. Judgments were to 
be made on whether the individual 


ucted to 
basis of 
the possible 


"It is recognized that the assumptions (e.g., 
continuous variable, homogeneity, homoscedas- 
ticity, numerous arrays) for the computation of 
the Pearson r were not met here. The most 
appropriate measure here would have been use 
of the contingency coefficient. Since many of the 
theoretical cell frequencies were less than the 
value of five, the value assumed necessary by 
Edwards (6) for legitimate use of this method 
contingency coefficients were not used. The ob. 
tained values of the Pearson r do indicate, how- 
ever, a high level of agreement between the 
judges as to the objectivity of the classification 
categories developed. 
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actually said or implied satisfaction, 
: H 

tension, etc. The correlations between 

j i stigator, ра on 

judges and the investigator, based 

277 idea units, were as follows: 


'E & Judge 4 = .go 
Е & Judge B = .89 


Judge C was given equal ашп 
with the classification scheme but wit 
one further instruction: to make ink 
ences, with attempts to get at the pa 
logical significance of the expressed © 
inferred hedonic tone. Correlated wit? 
the classification made by the ine 
gator on the same basis, the obtains 
value of r was .69. While lower in magn! 
tude than the coefficients obtained ma 
the idea units were classified on nim 
report, as adopted here, this value ws 
indicate that the objectivity of Be 
types of classification is high. : 1 

Objectivity of the Orientation oh 
Thought Categories. The same 11 in’ 
view protocols were classified by el 
judge and the investigator, and on 
tivity of classification in broad p 
ries was measured by the Pearson ility 
value of .94 was obtained. A reliabi 4 
coefficient of .64 was obtained for € he 
sification of the subcategories ah s 
nine major divisions. These values ЇЇ ad 
cate that both classification in mae 
and subcategories of the orienta ase 
thought was sufficiently objective fo" ™ 
here. hi 

Objectivity of the Source-of- Thone 
Category. A sample of 277 idea Ч in- 
was classified by one judge and ше "he 
Vestigator for source of thought. 95 
obtained reliability coefficient was ‘are 
All of the above correlation values ha 
Significant, and we may conclude and 
the classification system developed anc 
used here is of sufficient reliability dng 
objectivity to serve as а basis for 165 
our hypotheses. 


Jas- 


SELECTED PERSONALITY 


IV. ANXIETY IN THE 
LEARNING SITUATION 


A, ANXIETY AS MEASURED 
BY THE RORSCHACH э 


The Rorschach record is capable of 
providing two types of indices of anxiety. 
With a well-systematized type of anxiety, 
le. what May (13) has termed neurotic 
anxiety, the individual has already pro- 
duced a neurotic defense system, evi- 
denced by marked changes of personality 
Structure, resulting in both compulsive 
and hysterical personality characteristics. 
Klopfer and Kelley (11), however, sug- 
gest that this type of anxiety is less 
likely to become manifest on the Ror- 
schach protocols. They write that it is 
the reactive depression or anxiety state, 
referred to as an unsystematized anxiety, 
that affects the record more easily. 
Carried one step further, it is an inner 
tension of a generalized “free-floating” 
nature, and represents ап ineffective 
effort (as inferred from the record itself) 
to intellectualize the anxiety. Neurotic 
anxiety, moreover, involves the mecha- 
nism of repression, and differs from this 
free-floating or normal anxiety by its 
symptomatic nature. In May’s words: 

Normal anxiety [is] that which is used for a 
constructive solution to the problem which 
causes the anxiety, and neurotic anxiety [is] 


that which results in defense from avoidance 
of that problem (1g, p. 199). 


Following May, anxiety is here con- 
ceived as a pervasive inner tension moti- 
vating the organism to protect itself 
against anticipated psychic pain: Since 
individuals differ with respect to ego 
Strength or inner psychological security, 
it is reasonable to suppose that they also 
differ with respect to anxiety level or 
readiness. Correlatively, there may exist 
individual differences in the amounts 
ОЁ anxiety which can be handled with- 
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out resorting to maladaptive responses. 
If anxiety exceeds the adaptive thresh- 
old, then rigid, emergency behavior 
may result. The individual's response 
latency, and thus his ability to perform 
noegenetically, is reduced, with the re- 
sult that he is forced back upon familiar, 
habitual responses inappropriate in the 
given situation. 

From these considerations, we may 
derive our two hypotheses: Hypothesis 
I: If the anxiety is above individual 
threshold, it leads to an impairment in 
the ability to improvise in an unstruc- 
tured and/or new situation. This results 
in stereotyped, habitual, and familiar 
approaches that may be maladaptive in 
the situation. Secondly, excessive tension 
may so interfere with the perceptual 
processes as to considerably reduce 
problem-solving efficiency. The necessity 
for responding immediately may affect 
both the perception of the stimulus 
situation and the adequacy of the re- 
sponses. This inability to be problem 
oriented may thus arouse concern for 
one’s own psychological well-being, with 
increasing concern about self-adequacy 
for meeting the situation. From this we 
come to Hypothesis II: If anxiety is 
above individual threshold, the individ- 
ual becomes self-engrossed and con- 
cerned with his personal adequacy. 

To obtain an index of individual 
anxiety-readiness level, two Rorschach 
experts were asked to rank the 11 pro- 
tocols in terms of this threshold. Indi- 
viduals with a high readiness level, it 
was postulated, would be more sensitized 
to situational factors, and would be 
thrown into a disturbed state on less 
provocation than individuals with low 
anxiety readiness. The rank-order reli- 
ability of the two ratings (.80) was signifi- 
cant at beyond the 1 per cent level with 
9 df. After the 11 subjects had been as- 
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signed pooled ratings on the basis of (1) and Quantitative (Q): pete etm 
these judgments, they were divided into represents knowledge of voca е е Q 
three groups taken as having low, av- the ability to reason with words; valle 
erage, and high anxiety readiness. score measures skill and speed. ah n 
metical computation, numerical reas i 
ing, aħd rather high-level nonnumerica 
reasoning. The Reading test given on 
College applicant calls for the use o 
verbal skills and inductive reasoning: 
The Writing test, more structured than 
the Reading, calls for the correction o 
poor grammar or errors in other aspects 


3 s ad- 
of the mechanics of writing. In the yen 
a clearly defined stimulus situation in ing test particularly, the student is fa 


which the student need only sit and witha situation calling for improvisation 

listen; he is not required to submit under the pressures of situation? 

verbal evidence of comprehension. anxiety. The obtained correlations Я 
The discussion classes in the College, presented in Table 1. 

on the other hand, present the student 


B. Tue Crass SITUATION 


Anxiety as a constructive agent ac- 
companies adaptive striving by the total 
personality. It is conceivable that varia- 
tion in classroom methods of treating 
the course materials may tap different 
levels of individual anxiety reactions. 

* 'The lecture class, for example, represents 


with a very different situation. Here the © TABLE z een EN- 
^ В ANK- E zLATIONS BETWEEN © 
student is expected to prepare in ad- ake Оран. Соравиа AND ANXIETY 


vance, and to participate in discussing 


NESS, RIGIDITY, AND NEGATIVISM 
and solving the problems raisél. There = E 


m 
is the constant likelihood of being called Variable Anxiety | Rigidity viam 
upon to offer interpretations of ideas - mer 
and concepts. It is important for the ACE Re а: we 
student to attack the problems correctly, Writing Test о —i4a ee E. 
since his treatment of any question is RETINE Ia cu | «з fic 
available for all class members to judge * Significant at the s per cent level of C9" 


and evaluate. Motivation is ordinarily tenes 
supplied by some form of tension or 
mild anxiety, and it may be assumed that 


the anxiety-relief attendant upon correct ability to improvise with new mater 
responses will constitute a positive rein- 


Moss PES: jety- 
зовон decreases as the individual's аП®* ais 
forcement for the individual. This relief, readiness level increases. The causatio! y 

й ascs. m a 
however, is usually only temporary, for probably circular, for poor ability 2 
the anxiety may be rearoused by the lead to anxiety as well as vice versa. 
anticipation of being called 


ort 
The values in Table 1 tend to SUPP 


i th 
our first hypothesis: namely, that jals 


tion: 

А again 2. The Comprehensive Ехатіта! 

where he might fare badly, апа accord- Some parts of the Social Science exa 5 
ingly suffer deflation of self-esteem in the ination represent subject-matter qivisio™ 

eyes of his classmates. while other parts are more specific. p 
а 

С. EvIDENCES ОЕ ANXIETY IN THE functional, in the pene Thet they jlls 

TEST SITUATION relatively specific abilities aa yange 

T developed in the course. The parts ^ а] 

1. Aptitude Tests. The ACE provides from the recognition-recall of fact" ^ 
two scores for each student: Linguistic епо“ 


material to the ability to apply ™ 
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developed in the course to the handling 
of new materials. It should be noted 
that the student's course grade is deter- 
mined solely by his performance on this 
comprehensive examination. Thus, his 
future in the College, as well as cliances 
for scholarships and other awards, are 
all dependent on the results of these 
tests. 

The Social Science examination in 
1950 consisted of eight parts in dealing 
with the topics covered. These have been 
arranged here in four areas, each area 
designed to test the different types of 


and familiar problems. The correlations 
between anxiety-readiness level and per- 
formance on the four areas of the Com- 
prehensive are shown in Table э. 

Part I, which requires only the recog- 
nition of correct factual alternatives, is 
the only one of the four which correlates 
positively with anxiety-readiness level. 
Part II, calling for independent prepara- 
tion of materials prior to organizing 
and interpreting them on the examina- 
tion, correlates negatively and signifi- 
cantly with the anxiety ratings. The 
coefficients for Parts П and IV indicate 


TABLE 2 


RANK-ORDER CORRELATIONS BETWE 
Four Processes TE! 


XIETY READINESS, RIGIDITY, AND NEGATIVISM AND THE 
ON THE SOCIAL SCIENCE I COMPREHENSIVE 


Part 


Process Anxiety | Rigidity | Negativism 
I Recall through identification. .....: nnn .34 | .o3 
II Analyze and interpret course materials.........- —.48 E | —.09 
Ill Compare authors read in and out of the course......| —-61* =. .2ї 
IV Express in writings critical judgments on problems rel- 
ative to those in the соцгзе..........-+-+++-+°° —.42 —.71* —.03 


* Significant at the 5 per cent level of confidence. 


required cognitive processes fostered by 
the College program. These include: 


Part I. Recall through recognition of either 
(d) facts and generalizations about American 
history, or (b) the general nature of an author's 
position. 

Part П. Analyze and interpret, cither the 
papers read in the course or similar papers. This 
includes the ability to (а) identify the main argu- 
ment of the presentation or discussion, or (b) 
recognize the kind of argument for policy of 
general views expressed by the author. 

Part III. Compare authors, i.e., identify simi- 
larities and differences (a) as to how issues are 
defined, or (b) as to arguments and conclusions. 

Part IV, Express in writing (а) simple analysis 
of any historical period studied; (b) the student's 
critical judgment on a problem relative to those 
dealt with in the course. 


Considering the stressfulness of this 
test situation, we would predict from our 
first hypothesis that problems containing 
unfamiliar subject material would be 
less adequately handled than structured 


that when called upón to interpret the 
general views of a particular writer, or 
to treat narrow topics in a defined 
manner, those students whose anxiety is 
easily clicited perform less ably. The 
obtained results thus bear out predic- 
tions based upon an a priori classifica- 
tion of examination materials. 

In summary, individual susceptibility 
to anxiety varies inversely with the 
ability to reorganize or to make fresh 
attacks on familiar topics. It would 
appear that high anxiety has deleterious 
effects upon the ability to improvise or 
change set. 


D. Tue Conscious THOUGHTS 


It was previously hypothesized that a 
relationship exist between Ше 
amount of thinking the individual does 


may 
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about himself and his susceptibility to 
anxiety. A rank-order correlation of .65 
(significant at the 5 per cent level) was 


obtained between the Source of Thought - 


classification Self and anxiety threshold. 
The frequency of those thoughts 
grouped under Concern about the Self 
correlated .47 with anxiety. These 
coefficients suggest that the anxious indi- 
vidual is troubled with feelings of per- 
sonal inadequacy. Consequently, we 
should predict that anxiety will vary 
directly with negatively directed thoughts 
and self-confidence. To test this, the clas- 
sification Concern about the Self (See 
Appendix A) was divided into "positive" 
content units (e.g, personal adequacy, 
feelings of intellectual Superiority) and 
"negative" content units (e.g., those re- 
lated to inferiority feelings). 

The obtained correlations, —.33 with 
feelings of adequacy and .бо with feelings 
of inadequacy, Support our initial hy- 
pothesis concerning the direction of 
thoughts about the self 


, and appear to 
indicate 


à withdrdwal into the self.8 


ë The first class sessio; 
towards individual 
essay. Students wit 


readiness were concerned with the 
performance, ts are selected 


having high, 
s: 
High Anxiety Readiness 


Ernest: "I was concerned about my essay, I 
had quite a terrible grade on it. I wondered 
whether or not I should Speak to him [the 
instructor] after class, or call him at home this 


evening. I was also interested in the others’ 
grades." 


Average Anxiety Readiness 


Robert: "My primary concern Was my own 
paper. I looked at it; I was apprehensive as to 
what I should do. I was really very worried as 
whether or not I had gotten my idea in writin Ы 
This was inteusified by his example, about how 
this girl did put her thoughts down, 1 was 
confused as to his grading system, I didn't 


E. 
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These results suggest that other kinds of 
withdrawal from the threatening class 
situation may also occur. ‘Thus his 
might expect that the higher the d 
readiness, the more the individual wi 
attend to objects in his нра. 
rather than to the subject matter itself. 
The obtained rank correlation between 
anxiety level and the frequency of pi 
tion to irrelevant concrete objects іп 
the classroom was .55, while the a 
tion with thoughts about the subje 
matter was only .10. Since the Mies 
in the class are quite structured, ime a 
and unchallenging, it is possible slag 
they become anchorage points rari 
themselves to remove the individuí 
from the class material. 3 
It is assumed that the individual a 
fronted with a threatening situation € 
his inability to cope with that DR 
as well as future occurrences of “е at 
threats. Consequently, it is plausible t к 
the individual will attempt to ше 
himself for a class discussion by oe 
through notes, reading the text, ОГ е. 
puting answers in anticipation of Бе is 
called on to recite, This formulation" 
Supported by the positive correlabe a 
:92 obtained between anxiety-readin 
level and these kinds of class ance 
Since the ability to deal with new 


. per 
know how Well I did even after I got my P 
Баск,” d 

Jack: “ү thought of my essay. It seem 
adequate to him, therefore, later to me. 
Concerned with evaluation, and therefore «ten 
tened to him, -.. I wondered who had W ot. 
this essay he had read. I wondered if ine nave 
essay I wrote in а personal tone woul 7 а 
been better than this impersonal one 


e 
+ grad 
handed їп... . | wondered what Frances’ 8 
Was.” 


1 іп“ 
was 


Low Anxiety Readiness a 


Frances: *| was thinking of my paper 
concerned about it. I had scen it ae " 
enthused about it, It was rather short- 


as 
IW " 
wasn 


i 
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terials and organizational problems is 
somewhat suppressed by high anxiety, 
little attempt to relate old class materials 
to new subject matter is expected. The 
relevant correlation of —.70 was signifi- 
cant at beyond the 5 per cent level. 

It will be remembered that the prob- 
lem-solving category developed had been 
divided on an a priori basis into two cate- 
gories: (a) the ability to give factual 
answers; and (b) the ability to relate and 
synthesize materials. Anxiety might be 
expected to correlate positively with the 
former kind of ability, since previous 
preparation would enable the student to 
make correct responses. It should be 
noted, however, that we were not con- 
cerned with the actual correctness of the 
reported answers, but were interested 
only in the efforts made in that direction. 
However, the obtained correlations, .44 
with the whole category of problem solv- 
ing, —.47 with application, and .24 with 
solutions, though suggestive, are not sta- 
tistically significant. 

In summary, the data obtained from 
the reported conscious thoughts indicate 
that if anxiety is aroused beyond the in- 
dividual's threshold, responses which ob- 
tain tend to be stereotyped and readily 
available. When new approaches to fa- 
miliar material or materials are 
called for, response is made via familiar 
and habitual approaches, the anxious in- 
dividual being less capable of improvis- 
ing in the situation. In addition, with- 
drawal from the situation may take place 
in the form of concern with concrete ob- 
jects in the class situation, or in terms 
of self-engrossment in the direction of 
concern with self-inadequacies. 


new 


E. DiscoMrort-RELIEF QUOTIENT 


> 
The discussion thus far has been con- 
cerned with the correlates of anxiety 
level and the anticipatory nature of anx- 


iety. It may be assumed that it is the 
poorer student who is most affected by 
anticipatory anxiety, and who may, con- 
sequently, tend to have a higher anxiety- 
readiness level. However, the scholas- 
tically superior student may be equally 
uncomfortable in the classroom situa- 
tion, though for a different reason. He 
may be bored and impatient to proceed 
to a more challenging consideration of 
the subject matter. Whereas the discom- 
fort of the poor student may result from 
anxiety due to feelings of inadequacy, 
the discomfort of the good student may 
result from lack of stimulation or bore- 
dom. 

‘To test this hypothesis, the 11 subjects 
were divided into three groups on the 
basis of the final grades obtained in 
Social Science I: the A-B group, the C 
group, and the D-F group. As shown in 
Figure 1, the mean DRQ's for both the 
high and low groups are not significantly 
different. As anticipated, the good and 
the poor students are the ones who ex- 
perience the greatest amount of class dis- 
satisfaction. 

When the mean DRQ's were computed 
for groups divided on the basis of per- 
formance on entrance examinations, the 
results obtained for both the Reading 
test and the ACE examination followed 
the pattern found with course grades (see 
Fig. 2). For the Writing test, however, 
DRQ varied inversely and in a linear, 
rather than the U-shaped fashion, with 
test performance. The average student 
for the group, while he may experience 
discomfort, is the one whose understand- 
ing is met somewhat by the class discus- 
sion. In other words, it is possible that 
the obtained relationships indicate that 
the class situation is geared to the middle 
student at the expense of losing the good 
and poor student by boredom for the one 
and difficulty for the other. 
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Finally, the DRQ correlated — .64 with 
ratings of anxiety-readiness level, This 
coefficient, significant at beyond the 5 per 
cent level, suggests that the individual 
may develop various mechanisms, such as 
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tack, often because of environmental con- 
tradictions, he is relatively less able to 
adapt to a new situation. Intense emo- 
tional involvement and concreteness of 
behavior are observable correlates and 


DRQ Index = 
D 
DFR 
с DF Grades 
High Medium Low ACE 
LEGEND 
———— Letter Grades 
----- ACE 
Fic. 1,.—G 


тоир mean DRQ plotted against Social 


Science I grades and ACE score; 


groups High, Medium, and Low. 


DRQ Index 


Test Score 


LEARNING 


SITUATION 

A. Tue CONCEPT ор Riciwiry 
Common to the a 
ity (8, 9, 15, 
the values о 


Pproaches to rigid- 
16, 17) is the idea that when 
Е the individual are threat- 
ened or are especially vulnerable to at- 


Medium Low 


LEGEND 
— ——— Reading 
Writing 


Possible preconditions of the occurrent 
of rigid behavior. Freud conceived rig" d 
ity as a defense mechanism aimed at sie 
venting the rise to consciousness of "i 
tain repressed impulses which are ui 
ceptable to the person's superego Và aly 
Unexpected disturbances, if sufficie? 


b (9) 
Severe, cause "catastrophic mese by 
. di 9 | 2c 
Which are repetitive and stereotype the 
virtue 


of their dependence upon 
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individual's long-standing security pat- 
terns. Accordingly, the individual with 
à low "catastrophic threshold" tends to 
avoid those situations requiring spon- 
taneity and variability of response. He 
Seeks out and functions best in a highly 
organized, unchanging environment. In 
the light of this, we set up our three 
hypotheses for investigation here: Hy- 
pothesis I: The greater the predisposi- 
tion towards rigidity, the more likely 
will the individual fixate on a response, 
and not alter it, especially in the direc- 
tion of the class material. Hypothesis II: 
The greater the predisposition to rigidity, 
the less able is the individual to organize 
material in a stress situation. He can, 
however, cope with structured and avail- 
able concrete materials. Hypothesis III: 
In the general situation, the greater the 
individual's predisposition to rigidity, 
(ће more will he relate situational 
changes to himself. 


D. A Measure or RIGIDITY PREDISPOSITION 


On the Rorschach record, it has been 
noted (11, 19) that rigid subjects tend to 
Minimize movement, color, shading, and 
Perspective responses. Their responses 
are impersonalized, constricted, tend to 
be few in number, and are usually con- 
centrated on the last few cards. 

Responses showing good form (F+), 
but without shading, indicate poor abil- 
ity to relate oneself satisfactorily to 
people and social institutions. Klopfer 
and Kelley (11) assert that the control of 
any subject of above-average intelligence 
Whose record contains more than 50 per 
cent F, cam be called constrictive. It may 
be assumed that the more closely the 
Percentage of F+ responses approaches 
one hundred, the higher is the degree of 
rigidity. 

The percentage of animal responses 
(4) appears to follow the general pattern 
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of inhibition versus impulsiveness as re- 
vealed in the rest of the Rorschach 
record. In general, a high A% tends to 
indicate inhibition, rigidity, or a narrow 
range of interests. 

In the present study, two Rorschach 
experts were asked to-rank independently 
the 11 protocols along a continuum of 
predisposition towards rigidity. The ob- 
tained rank-order correlation of .75, com- 
puted as a measure of rater reliability, 
was significant at beyond the 5 per cent 
level. After the pooled ratings obtained 
in this manner had been assigned, the 
subjects were divided into high, average, 
and low groups on the basis of their ap- 
parent predisposition to rigidity. 


C. Tue Test SITUATION 


1. The Aptitude Tests. It has been 
postulated that the emotional reactions 
elicited in a test situation may tend to 
constrict” the individual and interfere 
with his cognitive performance (15, 17). 
From our second hypothesis, we would 
predict a positive relationship between 
rigidity and the ability to deal with con- 
crete materials. The low positive correla- 
tions which were obtained between rigid- 
ity on the one hand, and the ACE scores 
and the Reading and Writing tests on 
the other are presented in Table 1. Since 
each of these tests depends at least par- 
tially on recall without organization, the 
results are in line with our expectations. 
With only one exception, all of the co- 
efficients obtained are low but positive. 

2. The Comprehensive Examination. 
The parts of the comprehensive examina- 
tion in Social Science I offer another area 
in which to test our second hypothesis. 
The obtained correlations between rigid- 
ity and performance on each of the four 
areas of the Comprehensive are pre- 
sented in Table э. 

The index for Part I suggests that as 
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rigidity increases, so does the ability to 
deal with structured, familiar material 
in a stress situation. The value of rho 
(.73) is significant beyond the 5 per cent 
level. However, this increase may not 
continue indefinitely; for rigidity be- 
comes maladaptive when extreme. With- 
in limits, however, the above trend is 
quite probably effective. It should be 
noted that Part I calls merely for recogni- 
tion of previously learned materials with 
little else required. 

Part П deals with previously en- 
countered materials, but in a new 
fashion. It may be assumed that some 
acquaintance with the manner of sub- 
ject-matter treatment exists, and that the 
student has some ability to perform the 
necessary operations when he enters the 
test situation. The correlation here is not 
Statistically significant. 

The highly significant negative cor- 
relations between rigidity predisposition 
and the organizational parts of the ex- 
amination indicate that rigid individuals 
lack the ability to use fresh attacks in 
dealing with such problems. It is possible 
that these subjects resort to methods 
proven successful in the past (i.e., “old 
learning", when they find themselves 


unable to deal with the materials in the 
fashion demanded. 


D. Evidence of Rigidity in the Gonscious 
Thoughts 


Experiences of 


perseveration of words 
and phr 


ases in the classroom correlated 
with rigidity predisposition to an extent 
represented by a rho of :б2, a value sig- 
nificant at the 5 per cent level. These stu- 
dents appear to be still concentrating on 
material the rest of the class has left, a 
phenomenon suggesting an inability to 
tolerate overlapping situations or to re- 
spond simultaneously to more than one 
set of stimuli. It may be that this “need 
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for structure” carries over into the realms 
of problem solving and evaluative be- 
havior. 

Problem-oriented behavior was — 
tively though not significantly associated 
with rigidity predisposition (rho = 
—.14), and correlated positively (rho = 
-31) with orientation to the ideas under 
class consideration. It is possible that the 
more rigid individual tends to be n 
tive only to those ideas which are clearly 
defined and structured. Support for this 
hypothesis obtains from the mace 
of .43 obtained between measured Tipi 
ity and the frequency with which due 
within sight and hearing were perceivec- 
External objects and concrete ideas sha = 
in common the attribute of tangibility: 
they call for little interpretation ог rA 
jected meaning on the part of the ^ 
vidual. Though its verification must 
left to future research, it is reasonable to 
suppose that the ideational responses ? 
the "stimulus bound" individual may s 
as rigid and stereotyped as his aru n 
Tesponses—that rigid activity imp" 
rigid thought. 

Freud has postulated that in orde lj- 
maintain his repressions, the rigid e 
vidual must set up an inflexible Р е 
of defenses, Any weakening of the 
fense mechanisms involves the dan ies 
that repressed, unacceptable jen 
may break through into conscious" ^. 
The necessity for continuously maint@ p 
ing his defense system intact may P 
mote in the individual an inpet: 
rigidity and an increasing concern bs 
himself (cf. Hypothesis III). 

The interview data indicate tha пес 
of this self-directed thinking is concer s 
with the individual’ own inadequaat 
(see Table 3). It has been pu. e 
noted that the rigid person tends is pe 
refuge in some kind of conformity, ер: 
academic conformity. Thus the ane 


r to 


ger 


t most 
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TABLE 3 


RANK CORRELATIONS BETWEEN RIGIDITY PRE- 
DISPOSITION AND THOUGHTS ABOUT THE 


S AND PEOPLE 
Variable Rho“ 
Total Self | бо* 
Self: Neg: | 52 
Self: Positive | 20 
Teacher...... | —.55 
Other students —.20 


* Significant at the 5 per cent level of confi- 
dence. 


ancy between his social conformity drives 
and the realities of his own personality 
characteristics may to develop 
within the individual a negative reaction 
to himself, a state of affairs designated 
by Horney (10) as a "sacrificed subjective 
environment." 
The data of the present study indicate 
that negative thoughts about the sell 
\ are associated with increasing rigidity 
| predisposition. It is possible that in turn- 
ing his experiences towards himself, the 
rigid individual is able to turn away 
from those areas where his defenses are 
Jeopardized, and thus remain within the 
narrowly circumscribed areas in which 
he feels secure. 


cause 


E. DISCOMFORT-RELIEF QUOTIE 


т 

By becoming more concerned with 
himself, the may psycho- 
logically withdraw from the objective 
situation, thus reducing threat to a mini- 
mum. The above results support the hy- 
pothesis that as the individual comes into 
a threatening situation, he will attempt 
either to withdraw or to introduce sta- 
bility by clinging to concrete details and 
familiar objects. These affective elements 
are so fused into his perception that he 
becomes part of the external world which 
changes as these elements shift in their 
dynamic relation to him. If such mecha- 
nisms are effective, little discomfort 


individual 


should be experienced in the class situa- 
tion, for the withdrawal and concrete 
perception will serve to protect the in- 
dividual. As anticipated, none of the cor- 
relations obtained between rigidity pre-- 
disposition and parts of the DRQ was sta- 
tistically significant (Satisfaction = —.05, 
Dissatisfaction = —.43, Ambivalence = 
49, Neutral 2.18, and Total DRQ = 
81), 

If we can assume that rigid individuals 
tend to internalize threatening environ- 
mental stimuli, the negative correlation 
with dissatisfaction can be partially ex- 
plained. It must be noted, however, that 
the DRQ represents a proportion be- 
tween the amount of discomfort experi- 
enced and the sum of both idea units of 
satisfaction and dissatisfaction. Thus it 
may be that although the individual is 
physically removed from the situation, 
he is not entirely withdrawn from it emo- 
tionally,"and accordingly continues to 
experience some discomfort, In line with 
the above, it may be noted that the cor- 
relation between rigidity and ambiva- 
lence is the highest of the values obtained 
for parts of the DRQ classification. 


VI. MANIFESTATIONS OF 
NEGATIVISM IN THE 
LEARNING SITUATION 
А. A MEASURE ОЕ NEGATIVISM 
It is generally conceded that nega- 
tivism is a learned response that may 
be aroused in the individual by stimuli 
perceived as threatening providing that 
such reactions are not contraindicated 
by the presence of contrary needs or 
drives. Rorschach (18) suggested that re- 
sponses to white spaces (S) on the 
Rorschach cards are indicative of opposi- 
tional tendencies. In $ responses, the re- 
lationship between figure and ground is 
reversed, the ink blot being seen as 
ground, and the white part of the card as 
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figure. The 11 records obtained in the 
present study were rated for negativism 
by two Rorschach experts. The obtained 
reliability coefficient of -70, significant 
at the 5 per cent level, was deemed suffi- 
ciently high to justify assigning to each 
subject the combined rating of the two 
judges. 


B. THE TEST SITUATION 


1. Aptitude Tests and Comprehensive 
Examination. Tables 1 and ? present the 
correlations of the negativism ratings 
with the aptitude-test scores and compre- 
hensive-examination Scores, respectively. 
Since individual negativism is quite re- 
moved and unrelated to the objective 
criteria that the College sets up to meas- 
ure the students’ ability, whether one 
scores high or low on the test should 
make little difference as compared with 
the amount of individual negativism. As 
might be expected, all of the obtained co. 
efficients may be accounted for on the 
basis of chance. It may be hypothesized 
that the high Motivation to succeed, 
characterizing a competitive situation, 
tended in this instance to prevent the 
actual expression of the latent negativism 
which may have existed. It is also pos- 
sible that the College student accepts the 
comprehensive-examination Program as 
part of the educational plan, and dis. 
places his Oppositional attitudes from the 
test situation to areas Where grades and 
class status remain unthreatened, 


С. MANIFESTATIONS OF NEGATIVISM IN THE 


Conscious THoucnts 


1. The Self as a Focal Point, 


In the 
classroom situation, open rebellion 
against the procedure, the course, the in- 


structor, or other class members is usually 
penalized in some manner, In such cir- 
cumstances, the expression of resentment 
will usually remain covert, and may be 
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directed toward the self. The obtained 
correlations between ratings of nega- 
tivism and kinds of thinking about the 
self tend to bear out this hypothesis. 
Though not statistically significant, the 
coefficients Suggest that thoughts about 
the self increase as the individual's op- 
positional tendencies increase. (rho — 
-34), and that these thoughts tend to 
grow more self-critical as negativism 
grows more intense (rho = .52). Nega- 
tivism and positively directed thoughts 
about the self are inversely related fo » 
slight degree (rho = —.12). The ee 
is mostly about the individual’s persona 
and intellectual adequacy (or inade- 
quacy) related to the other class mem 
bers. 


5% ; about 
Moreover, Positive thoughts abc 


other people correlated —.45 with negr 
tivism, while negative thoughts sta 
others correlated 67, a value Mg 
at the 5 per cent level. In general, шо 
individuals Whose Rorschach Хеш 
showed high negativism also display" 
considerable concentration on the pal 
adequacies of both the self and others in 
the class session, as the following inte! 
view €Xcerpts indicate: 


Ernest: 


is 
áü he 15 
Frances , , 


$0 smart. I don't feel. prejudiced 
(the smart Students) | | | not envious or an s" 
like that, But I do wish that I would ans 
like that. I do respect them." 10165 

"Miss K——_ certainly does have her E she 
I thought, And that Max Factor make еп: 
uses, Heavens, she's practically a Had she 
Then again, everyone looks at her, ап 
glances back so suspiciously.” in this prob" 

"I wasn't particularly interested ies [ihe 
lem. Instead, 1 thought of Mr. N—— үп eyes 
instructor]. His teeth are so yellow; кү X 
with a beautiful parting in his hair. 
wish he Wouldn't wear those comica 
shoes |, they look so cheap and have 
polish on them, probably liquid. Also, I back 
With his back to the blackboard, so the wasn't 
his suit is full of chalk, The tie he varie was 
half bad, either. Most amusing, I thoug 


SI 
+ She's the smartest one. hem 
against {NC 
5 ything 
уст 


ато, 
he stant 
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the way he accentuates his problems . . . always 
underlining and putting circles around prac- 
tically everything. 
“I felt good that Mark had more criticisms on 
+ his paper than I did. He didn't seem too bright 
to me... Stan, oh, he's so smart . . . it burns 
me up. But he has no moral values . . . runs 
around . . . for his capacity of IQ, he could rip 
the class wide open, which he doesn't do. I 
don't know why. He is so well educated, but 
he has such low moral values. He doesn't know 
how to live." 


Ma 


"His [Jack's] voice is irritating; the tone of 
his voice. Sounds like it was coming from deep 
down and could be very contrasting. When he 
talks in class, he keeps talking, and never says 
anything. I thought that Mr. X——— was going 
to get mad at him one of these d ys. He wasn't 
too bad yesterday, I thought. But a lot of times 
he s to argue with Mr. X——— just for noth- 


ing, after the teacher has given him the right 
answer,” 
Jim: 


“LL was] thinking about where X——— gets his 
haircuts and his hats. Thought that they were 
| the worst looking things Гус ever scen in my 
life, He must get them at the Reynold's Club. 
Everyone who gets a haircut there . well, 
they're lousy.” 

"I wondered why she didn't stay on the farm. 
I can't understand why these women don't 
Stay at home and have babies. Thought that 
she typifies the typical U. of C. coed. Very 
intellectual and nothing else. I was thinking 
that this school had the reputation for very 
homely girls. Sce these girls walking around 
with these long, black stockings. Isn't that silly, 
Good Lord? I noted that Frances had a dress 
on yesterday, The first time since school began. 
I was thinking that we could always tell a 
U. of C. student when they came into our 
store," 


2. Negativism Directed Against the 
Subject Matter. Direct argumentation 
and contradiction of subject-matter treat- 
ment in class may induce more anxiety 
than the amount of tension dissipated. 
Hence, we might expect that the stu- 
dent will show his resistance in class in 
Covert ways which will not constitute too 
much threat for him. The obtained cor- 
relations between problem-oriented be- 
havior and ratings of negativism are pre- 
sented in Table 4. It is interesting to note 
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that as disposition towards negativism in- 
creases, a decrease in active problem solv- 
ing occurs. Moreover, negativism tends 
to correlate quite highly both with pas- 
sivity (e.g., following along in the book, 
taking notes, waiting for new materials 
to be presented), and with evaluatory 
orientation (e.g., criticizing the relevancy 
and cogency of a point made, agreeing or 


TABLE 4 


ELATIONS BETWI] N RATINGS ON 
1 AND PROBLEM-ORIENTED 
THINKING 


Variable | 


Problem Solving. 


Active Participation ( luation). .| 62* 
Negative Evaluation. .......... 234 
Positive Evaluation. ........... rm 

Passive Participation............. | «5%. 


* Significant at the 5 per cent level of confi- 
dence. 


disagreeing with the speaker). These data 
suggest that the negativism attendant 
upon poor problem-solving ability tends 
to be expressed either as dependence (cf. 
frustration > regression) or as irascibility 
(extrapunitiveness). 

3. Negativism Directed against Other 
Class Stimuli. Cameron (2) contends that 
the individual may manifest negative at- 
titudes by doing the opposite of what he 
believes demanded of him. Thus the in- 
dividual who is negativistic toward the 
classroom situation may attend to irrele- 
vant thoughts and stimuli rather than to 
the topics under discussion. Table 5 pre- 
sents correlations between negativism 
and degree of irrelevant thinking and 
activity. 

The correlation between oppositional 
tendencies and the performance of motor 
acts in class is significant at the 5 per 
cent level, suggesting that while passive 
in regard to the class material, the stu- 
dent can remain inattentive to it. The 
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TABLE 5 


RANK CORRELATIONS BETWEEN NEGATIVISM AND 
THINKING AROUSED BY ENVIRONMENTAL 


STIMULI 
Variable | Rho 
Thoughts of concrete situations оше : 
side the class... sit sopis LER zig jd 65 
Thoughts about physical activities, . -56 
Thoughts about objects within sight. -45 


* Significant at the 5 per cent level of confi- 
dence. 


highly significant correlation (tho = .80) 
between negativism and distractibility 
lends further support to this hypothesis. 
The index of distractibility used was the 
sum total of those ideas experienced dur- 
ing the class session which were not 
stimulated either by the topics actually 
discussed, by ideas directly related to 
those topics, or by the individuals’ own 
feelings about them. These coefficients 
suggest that negativism which das been 
inhibited nevertheless tends to manifest 
itself both ideationally and behaviorally. 


D. DISCOMFORT-RELIEF QUOTIENT 


The initial class used in this inv 
tion was recorded during the firs 


of attendance in the College. M. 
and ideas at vari 


estiga- 
t week 


aterials 
ance with the student's 
previous attitudes, values, and general 


orientation were presented. The follow- 
ing quotations, selected from the first 


recorded class, are presented to point up 


the climate being set up by the instruc. 
tor: 


"Do I-do I pose the problem correctly? Now, 
I'm asking you, I'm asking your cooperation on 
this matter. I Suppose a good number of you 
probably share the first part of the belief, and 
probably agree with the basis of government, 
. . 15 this argument a hard fact we've got to 
recognize as a consequence of our system? Or 
is there something wrong with the argument? 
I don’t know. Did I make the argument clear? 
What's the answer?" 

+ + * 


“That makes a good deal of sense, , |, Any 


other questions on the questions? Well, pen 
you take it away now and tell me, панаа 
this down, I'll try to be quiet; about—in = 
minutes—I'm going to come back in and see W El 
we've learned and what we've got. Go ahead, 
Stan.” 

While these two excerpts appear о 
indicate a permissive and accepting class 
room climate, the magnitude of the cor- 
relation between negativism and 5" 
DRQ for this class was quite high (gno 
— .57). This value was not even аро» 
mated for any of the other classes. But 1 
this was the classroom climate, why ея 
such a high coefficient obtained? It i 
possible that this result is attributable 4 
the unfamiliar, “progressive,” and d 
haps threatening nature of the new d 
terial presented. As the course d 
gressed, the students may have ра 
to the “startling” character of the cla 
work, or have been able to find some ke 
of satisfactorily venting their negativi ) 
feelings, thereby relieving their discont- 
fort. ин 

The trend of correlation values in р 
is not particularly consistent. B 
might be fruitful to inspect the !D : 
vidual records of the three students e 
highest on negativism and ацетр re 
seek out the dynamics of the quim 
shifts which took place during the per! 
of investigation, 


E. Individual Patterns 


Table 6 contains indices for the m 
individuals rated highest on negativ? , 
as inferred from the Rorschach pM to 
This table is of interest in pointing a 
the directions which individual ken 
tivism may take, Ernest ranked Ве оп 
in the group of 11 subjects in orient? and 
to people, the self, the instructor % pe 
the class group, as well as next tO 
highest in thoughts urse 
process, He received a С in the СО 
and his concern with class activity !5 
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in fact, all of the values are almost equal. 
Mark, while concerned with activities 
distracting from the class topics, failed 
the course. Jim directed his opposition 
towards people and objects removed 
from the class situation, as well as to 
ideas related but not directly bearing on 
the immediate subject matter. In spite 
of this orientation, his course grade was 
a C. Thus, we can see three differing pat- 
terns, each unique for the individual, 
adding support to the trends of nega- 
tivism discussed above. 


ucts can be inferred from test perform- 
ance? 

The majority of the data used in the 
present study were obtained by the 
method of stimulated recall recently in- 
troduced by Bloom (1). This involved re- 
cording 12 Social Science I class discus- 
sions in which the subject was a partici- 
pant. Within a 48-hour period following 
the class meeting, each student was indi- 
vidually interviewed and the class record- 
ing was played back to him. During the 
interview, the recording was stopped at 


TABLE 6 


PERCENTAGE OF IDEA Units RANKED WITHIN EACH CATEGORY BY THE THREE 
Most NEGATIVE SUBJECTS 


Mark 


Source of Thought Ernest Jim 

Material under discussion... 0.000 estes eee eeee 2.0 5.0 3-0 
A related ideasi se sss wes vsa 2.5 6.5 11.0 
Activity related to class (reading-writing 28 11.0 2345 
Self 11.0 9.5 3-0 
\ Instructor........ 11.0 4.0 1.5 
Other students. . II.0 Bs 8.0 
Object within sight or hearing 7.0 11.0 2.5 
Classroom situation or process. 10.0 1.0 3.0 
Someone not in the сЇаѕѕгоот...... 7-5 2.0 II.O 
Object or situation outside the imme iate environment. 4.5 8.5 10.0 


УП. SUMMARY AND CONCLUSIONS 

This study has been concerned with 
investigating the relationships between 
individuals’ recalled experiences in a 
series of class situations and certain rela- 
tively stabie personality characteristics 
as inferred from Rorschach protocols. 
More specifically, the following questions 
were investigated: 

1. What is the relationship between se- 
lected personality characteristics (viz., 
anxiety, rigidity, negativism) and the 
kinds of thinking done by a group of col- 
lege students in the learning situation? 

?. What is the relationship between 
selected personality characteristics and 
products of learning, where such prod- 


specific, preselected points (here called 
critical points) and the student was asked 
to recall the experiences he had during 
the actual situation. The 
thoughts reported during the series of 
weekly interviews were recorded ver- 
batim and constituted the conscious ideas 
for this investigation. These data were 
collected through 64 interviews con- 
ducted over a four months' period with 
11 students from one intact Social Sci- 
ence I class, registered for the first time in 
the College of the University of Chicago. 

A. The unit of response classified was 
a statement, clause, or phrase denoting a 
complete idea; each such unit was termed 
an idea unit. The following system of 


ideas or 
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classification for the reported conscious 
ideas was developed: (a) the stimulus or 
source of the experienced idea, called the 
source of thought; (b) the orientation or 
character of the idea unit, called the 
orientation of thought; and (c) the 
hedonic tone of the idea unit: this was a 
modification of the Discomfort-Relief 
Quotient (DRQ) developed by Dollard 
and Mowrer (5). 

B. Performance on the Social Science I 
comprehensive examination was classi- 


‘fied according to the type of required 


cognitive process called for on the exam- 
ination. The Rorschach protocols were 
independently rated by two experts on 
anxiety readiness, rigidity predisposition, 
and negativism; in each case, a high score 
means much anxiety, rigidity, or nega- 
tivism. The obtained reliability coeffi- 
cients between judges’ ratings based on 


the Rorschach were 80, 75, and .70, re- 
spectively. в 


A. RESULTS 


1. Anxiety readiness is neg: 
lated to general level of performance on 
tests of scholastic aptitude. (Rho = —.34 
with the ACE, —.66* with a reading test, 
and —.40 with a writing-mechanics test.) 

2. When an analysis was made of the 
comprehensive examination 
found to relate positivel 
part calling for rote г 
Negative values 


atively re- 


; anxiety was 
y only with the 
ecall, rho = 34. 
were obtained with 
those parts calling, respectively, for analy- 
sis of familiar materials (rho = —.48), 
for comparisons of familiar and um. 
familiar materials (rho — —.61*), and 
for critical evaluations of new materials 
(rho = —.42). 

3. High anxiety readiness character- 
ized those individuals who spent a great 


* Significant at the 


5 per cent level of confi. 
dence. 
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amount of time in class thinking about 
themselves in negative terms (rho = 
4-.60*). a 

4. Rigidity predisposition, as infer rec 
from the Rorschach, correlates positively 
with performance on materials calling 
for rote recall through identification (rho 
= .73*), but negatively with treatment af 
concepts or problems dissimilar to yon 
previously studied (rho = —.71*), а. 
those problems requiring new modes О 
attack (rho — —.71%). | " 

5. In class rigidity predisposition 1S 
positively correlated with thinking “wn 
class stimuli most readily available, ant 
with thinking about the self in negative 
terms (rho = .52). 

6. Chance relationships were found be- 
tween negativism and performance ы 
different parts of the aptitude or achieve 
ment tests. 

7. From the reported class experience? 
evidence was found to indicate that ne^ 
tivism may be manifested in several wa 
Values significant at the 5 per cent leve 
Were obtained between negativism n^ 
idea units concerned with negative pi 
critica] thoughts about other рёоР Е 
(tho = .67*), and criticism of ideas = 
pressed in class (rho = .62*). еда 
thoughts about the self were highly, bu 


Sb М ativ- 
not significantly, correlated with neg 
ism (rho — -52). 


B. Сомсіл0510%5 


The obtained results, while not ^t 
finitive, strongly suggest the ei 
relationships between certain pum 
learning, and achievement variables. ;ely 
following conclusions appear tentatiY 
justified: rize 

1. Anxiety and rigidity u 
those individuals less capable a jon- 
provising in a new problem ao 
While problems calling for re 
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through recognition can be dealt with 
effectively, it is the organizational rather 
than the stereotyped behavior which is 
predominantly influenced by these per- 
sonality variables. І 

2. Personality variables appear to be 
involved as influences in cognitive opera- 
tions. These relationships, in the test 
situation, are demonstrable only when 
ability-test items are classified and ana- 
lyzed separately by type of required cog- 
nitive process. 23 

3. The obtained results carry implica- 
tions for the measurement of personality 
through cognitive-ability tasks. 

4. The conscious thoughts, as made 
available by the method of stimulated 
recall, open a vast new area for investiga- 
tion, Research concerning the use of this 
technique is important in view of its 
Potential application. Investigators in 
Social psychology, group dynamics, and 
other fields will find the method a useful 
tool for research. The special merit of 
this methodology is that it permits the 
individual to participate freely in dis- 
cussion or other social situations at one 
time, and to serve as an observer of his 
mental activity in the discussion at 
another time, Since the interviews are 
conducted after the completion of the 
Social situation, they can have no effect 


om it. If future studies confirm our ex- 
ploratory studies as to the accuracy and 
the detail with which the recall is stimu- 
lated by the recordings, this should prove 
a most useful method of inquiry in the 
social sciences. There has long been a 
need for a technique in the social sci- 
ences in which the act of investigation 
would have little or no effect on the situ- 
ation being investigated. In general, the 
method of stimulated recall should be 
useful in many investigations of the rela- 
tions between overt and observable be- 
havior and the more subtle thought proc- 
esses of which the individual is conscious. 

The major result of the present in- 
vestigation has been the demonstration 
that the conscious experiences of a group 
of students in a series of class sessions 
over a period of time, as well as per- 
formance on certain objective tests, are 
related to certain personality character- 
istics. Tlie results are in accord with the 
view that no learning (with the possible 
exception of the conditioned-reflex type 
of learning) can be properly evaluated 
without regard for the personality of 
the learner. This is in sharp contrast to 
the early but persistent differentiation 
of behavior into cognition, conation, and 
affection, which are assumed to operate 
in virtual independence of each other. 
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APPENDIX 


CLASSIFIC: 


І. PARTICIPATION 


A. Active Participation? 


Synthesis 
4 Reconciliation of conflicting points 


3s RE discussion to general problem 
7. Relating specific to some abstraction 


Solution 
6:2 ген “ ‹ 
5. Answer problems or questions raised 
Application 
Bcd ips А $ 
5. Applies solution and/or idea—nonacademic 


4 Applies solution and/or idea—other academic 
material 


3. Applies solution and/or idea—in present course 
material 


= © related question or problem is raised 

+ Searching for relevant point in the text or 
Notes 

B. Evaluation 

7 rie of aesthetic qualities 

0. Ev i i 
‘valuates the complexity and meaningfulness 

j of the question or answer 

5. Evaluation of the class process or procedure 


4. Evaluated accuracy or authenticity of point 
illustration 

3. Evaluates relevance or cogence of point or 
illustration 

ii with point or illustration 

ae Isagrees with point or illustration 

urprised by point or illustration 


С. Comprehension 


Desires classification of a point 

New insight or understanding: reorganiza- 

tion of his ideas on the subject 

5. Recall of previously related experience or 
situations 

4- Ilustrates or relates it to another situation: 
nonacademic * 

3. Illustrates point or relates it to another situ- 
ation: other academic material 

. Illustrates point or relates it to another situa- 
tion: in course materials 

1. Anticipates or wants a particular illustration 

given 


*The number placed before each category 
does not have any value except to facilitate 
ordering of the data. 

Involves the actual doing or effort, and not 
Success of the action (such as giving the correct 
answer, accurate evaluation, etc.). 
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TION OF ORIENTATION OF THOUGHT* 


D. Passive Participation 


Curious as to what will be said 

Simple understanding; following and listening 
with simple comprehension 

Following and listening without compre- 
hension 


. Following in book 


Taking notes or following with book 

Just following or listening; paying attention 
Keeping ideas in mind, but also paying 
attention to other things 


II. DIVERSIONS 


Individuals and Their Personal Characteristics 
Instructor's characteristics and mannerisms: ` 
approval, positive 

Instructor's characteristics and mannerisms: 
disapproval, negative" 

Instructor's characteristics and mannerisms: 
nonevaluative and/or empathetic 

Student speakers’ characteristics and manner- 
isms: approval, positive 

Student speakers’ characteristics and manner- 
isms: disapproval, negative 

Student speakers’ characteristics and manner- 
isms: nonevaluative and/or empathetic 
Other person's characteristics and manner- 
isms: approval, positive 

Other person's characteristics and manner- 
isms: disapproval, negative 

Other person's characteristics and manner- 
isms: nonevaluative and/or empathetic 


B. Ideas and Words 


Captivated or attracted by unusual word or 
phrase or idea or name 

Amused by a remark 

Annoyed or bothered by a remark 

Tangential thoughts stimulated by word, 
phrase or idea 


C. Conéern about the Self 


Desire of knowledge about self, e.g, grades 
Concern about details of the self and activi- 
ties; care of self 

Feeling of personal adequacy: related to 
personal characteristics 


. Feeling of personal adequacy: superiority over 


someone in class, student or instructor, and 
related to discussion 

Feeling of personal adequacy or positive atti- 
tude towards self: agreement with the speaker, 
and other people 

Feeling of personal adequacy or positive at- 
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titude towards self: knowing the answer, 
comprehension or knowledge 

3. Desires opportunity to demonstrate personal 
adequacy on a particular point by overt 
participation 

2. Concern about possible demonstration of per- 
sonal inadequacy: possibility of being called 
on to recite; wishes to avoid overt participa- 
tion which will be judged 

1. Concern. about inadequacy of self: related 
to personal characteristics 

о. Concern about inadequacy of self: related to 
discussion and subject matter presented 


D. Other Activities 


9. Tangential thought unrelated to the class- 
room stimuli . 

8. Not paying attention 

7. Remembers the critical point, but cannot 
ed his thoughts of the time 

6. Difficalty in hearing 

5. Absent at this critical point 

4- Looking at some object Е 

3. Overt verbal participation in discussion ne 

2. Speaking to someone in the class, not reciting 

1. Occupied with other details: arranging books, 
clothing, getting organized 

о. Reading 

ПІ. No REcaLL 


——— 


o 


— 


^ 


° 


» й. j í 
h Bi t 
» | Ф 
г ‚ » " 
Я | | { [i * " * 
: w d ү} 
A 


